-- Logs begin at Wed 2022-05-18 15:55:22 UTC, end at Wed 2022-05-18 17:34:03 UTC. -- May 18 16:55:51.036010 dv-cinder-795785-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 18 16:55:51.049011 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 16:55:51 2022] *** May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: nodename: dv-cinder-795785-11-iscsi May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: machine: x86_64 May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: clock source: unix May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: pcre jit disabled May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: detected number of CPU cores: 4 May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: current working directory: / May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: detected binary path: /usr/bin/uwsgi-core May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: your processes number limit is 47680 May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: your memory page size is 4096 bytes May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: detected max file descriptor number: 2048 May 18 16:55:51.051332 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: lock engine: pthread robust mutexes May 18 16:55:51.052827 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: thunder lock: enabled May 18 16:55:51.052827 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 18 16:55:51.052827 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 16:55:51.100100 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: Python main interpreter initialized at 0x55bee31549c0 May 18 16:55:51.100100 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: python threads support enabled May 18 16:55:51.100100 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: your server socket listen backlog is limited to 100 connections May 18 16:55:51.100100 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: your mercy for graceful operations on workers is 90 seconds May 18 16:55:51.100564 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: mapped 403077 bytes (393 KB) for 2 cores May 18 16:55:51.100564 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: *** Operational MODE: preforking *** May 18 16:55:51.100825 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: *** uWSGI is running in multiple interpreter mode *** May 18 16:55:51.100825 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: spawned uWSGI master process (pid: 103236) May 18 16:55:51.101185 dv-cinder-795785-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 18 16:55:51.101646 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: spawned uWSGI worker 1 (pid: 103237, cores: 1) May 18 16:55:51.102612 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: spawned uWSGI worker 2 (pid: 103238, cores: 1) May 18 16:55:51.102779 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 16:55:52.416140 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 16:55:52.459553 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 16:55:53.173728 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 16:55:53.173728 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: from cryptography.utils import int_from_bytes May 18 16:55:53.174093 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 16:55:53.174093 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: from cryptography.utils import int_from_bytes May 18 16:55:53.196909 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 16:55:53.196909 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: from cryptography.utils import int_from_bytes May 18 16:55:53.197231 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 16:55:53.197231 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: from cryptography.utils import int_from_bytes May 18 16:55:56.131722 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 16:55:56.132461 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 16:55:56.132610 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 16:55:56.132882 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 16:55:56.133144 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 16:55:56.133541 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.133899 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.134230 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.134554 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.134891 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.135205 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.135534 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.135860 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.136190 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.136456 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.136776 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.137103 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-11-iscsi {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.137434 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.137775 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.138277 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.138614 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.138927 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.139252 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.139580 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.140902 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.141899 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.142223 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.142636 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.142897 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.143225 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.143543 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.143886 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.144187 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.144520 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.144840 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.145252 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-11-iscsi {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.145575 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.145928 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.146231 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.146658 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.146975 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.147303 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.147622 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.147950 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.148290 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.148596 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.148920 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.149243 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.149568 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.149913 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.150218 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.150537 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.150882 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.151172 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.151579 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.151878 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.152194 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.152547 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.152879 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.153291 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.153555 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.153863 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.154196 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.154520 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.154916 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.155237 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.156327 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.156769 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.157268 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.157611 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.158047 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.158359 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.158692 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.159018 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.159351 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.159667 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.159993 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.160414 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.160671 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.160989 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.161338 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.161697 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.162002 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.162326 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.162658 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.162972 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.163283 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.163623 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.164029 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.164364 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.164675 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.164932 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.165240 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.165554 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.165901 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.166236 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.166553 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.166858 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.167163 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.167475 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.167786 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.168102 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.168413 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.168722 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.169031 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.169340 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.169649 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.169980 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.170308 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.170635 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.171116 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.172036 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.172608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.172977 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.173310 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.173628 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.173966 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.174300 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.174615 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.174930 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.175383 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.175703 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.176040 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.176446 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.176762 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.177070 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.177397 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.177781 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.178154 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.178466 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.178778 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.179088 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.179401 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.179711 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.180020 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.180328 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.180667 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.180987 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.181323 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.181618 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.181952 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.182277 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.182684 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.182959 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.183311 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.183655 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.184069 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.184409 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.184734 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.185053 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.185374 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.185729 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.186051 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.186368 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.186720 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.187168 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.187740 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.188120 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.188451 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.188775 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.189101 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.189417 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.189767 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.190106 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.190435 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.190756 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.191099 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.191449 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.191770 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.192101 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.192431 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.192748 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.193062 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.193375 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.193726 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.194067 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.194383 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.194706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.195019 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.195335 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.195649 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.195963 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.196277 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.196625 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.196943 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.197266 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.197579 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.197924 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.198246 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.198562 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.199183 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.199492 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.199798 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.200109 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.200416 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.200742 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.201078 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.201388 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.201752 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.202067 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.202420 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.202871 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.203437 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.203806 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.204127 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.204442 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.204756 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.205086 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.205403 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.205737 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.206187 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.206503 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.206815 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.207137 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.207706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.208019 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.208360 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.208648 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.208979 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.209298 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.209612 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.209978 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.210315 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.210624 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.210954 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.211285 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.211606 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.211920 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.212250 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.212538 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.212847 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.213183 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.213576 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.213925 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.214397 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.214714 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.215046 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.215431 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.215764 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.216082 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.216392 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.216700 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.217012 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.217369 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.218342 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.218898 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.219319 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.219832 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.220170 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.220497 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.220824 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.221145 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.221467 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.221814 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.222137 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.222465 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.222787 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.223116 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.223436 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.223772 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.224093 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.224423 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.224734 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.225061 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.225408 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.225783 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.226110 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.226439 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.226760 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.227081 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.227397 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.227715 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.228034 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.228373 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.228690 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.229000 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.229326 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.229638 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.229995 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.230314 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.230638 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.230949 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.231271 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.231609 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.231942 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.232256 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.232572 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.232898 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.233215 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.233603 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.234535 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.235086 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.235483 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.235803 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.236130 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.236448 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.236768 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.237080 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.237402 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.237746 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.238059 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.238368 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.238694 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.239025 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.239338 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.239665 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.239992 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.240301 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.240610 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.240936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.241251 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.241559 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.241955 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.242191 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.242542 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.242872 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.243166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.243487 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.243813 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.244128 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.244449 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.244762 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.245076 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.245405 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.245747 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.246060 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.246375 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.246689 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.247002 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.247315 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.247647 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.247961 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.248278 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.248591 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.248905 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.249765 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.250164 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.251080 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.251427 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.251750 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.252078 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.252407 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.252733 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.253070 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.253402 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.253782 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.254099 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.254417 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.254729 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.255040 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.255356 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.255670 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.255982 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.256291 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.256605 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.256913 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.257222 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.257530 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.257880 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.258212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.258527 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.258841 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.259154 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.259482 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.259799 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.260107 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.260415 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.260724 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.261071 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.261383 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.261884 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.262229 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.262431 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.262802 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.263189 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.263519 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.263853 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.264162 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.264505 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.265363 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.265870 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.266418 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.266741 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.267061 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.267380 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.267697 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.268010 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.268325 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.268636 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.268958 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.269279 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.269583 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.269921 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.270236 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.270548 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.270859 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.271173 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.271481 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.271802 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.272146 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.272408 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.272715 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.273031 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.273343 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.273692 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.274012 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.274373 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.274684 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.274995 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.275329 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.275636 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.275953 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.276259 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.276587 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.276909 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.277216 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.277528 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.277905 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.278176 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.278482 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.278791 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.279098 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.279412 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.279739 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.280049 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.280881 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.281239 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.281830 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.282307 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.282623 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.282931 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.283284 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.283594 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.283957 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.284269 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.284590 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.284916 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.285234 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.285549 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.285893 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.286204 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.286524 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.286837 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.287155 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.287463 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.287776 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.288501 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.288832 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.289154 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.289486 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.289845 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.290184 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.290492 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.290812 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.291131 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.291445 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.291763 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.292077 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.292392 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.292706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.293022 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.293337 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.293649 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.293988 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.294304 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.294616 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.294926 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.295259 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.295572 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.295882 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.296751 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.297233 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.297801 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.298126 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.298579 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.298901 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.299221 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.299532 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.299851 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.300168 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.300495 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.300819 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.301130 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.301557 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.301900 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.302217 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.302535 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.302843 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.303151 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.303464 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.303835 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.304145 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.304453 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.304761 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.305088 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.305398 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.305746 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.306181 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.306497 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.306809 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.307350 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.307623 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 16:55:56.308137 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.308137 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.308541 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 16:55:56.308722 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.308722 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.308999 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.309137 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 16:55:56.309275 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.309518 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.309733 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 16:55:56.309929 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.310156 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 16:55:56.310317 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.310517 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.310787 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.310946 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.311108 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.311403 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.311556 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.312323 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.312833 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.313284 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.313440 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.313791 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.313971 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.314237 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.314519 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.314673 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.314876 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.315102 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.315247 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.315524 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.315704 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.315850 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.316132 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.316284 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.316433 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.316744 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.316888 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.317096 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.317393 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.317547 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.317742 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.317976 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.318131 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.318294 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.318581 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-11-iscsi {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.318735 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.318902 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.319187 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.319345 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.319520 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.319774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.319918 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.320126 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.320365 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.320511 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.320755 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.320948 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.321101 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.321375 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.321529 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.321790 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.322025 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.322179 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.322319 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.322622 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.322891 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.323036 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.323260 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.323569 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.323713 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.323885 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.324212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.324367 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.324542 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.324797 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.324950 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.325176 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.325389 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.325534 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.325839 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.326057 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.326212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.326476 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.326660 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.326815 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.327078 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.327928 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.328086 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.328541 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.328686 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.329078 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.329230 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.329401 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.329749 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.329908 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.330057 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.330345 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.330526 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.330670 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.330968 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.331119 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-11-iscsi {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.331281 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.331608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.331754 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.331922 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.332458 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.332617 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.332766 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.333030 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.333176 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.333401 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.333739 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.333893 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.334081 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.334385 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.334530 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.334714 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.334966 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.335110 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.335344 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.335575 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.335723 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.335977 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.336170 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.336314 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.336598 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.336742 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.336915 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.337233 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.337375 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.337555 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.337903 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.338061 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.338202 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.338494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.338651 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.338822 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.339102 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.339299 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.339680 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.339824 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.340076 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.340260 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.340413 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.340697 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.340839 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.341011 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.341325 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.341496 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.341636 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.341971 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.342116 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.342284 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.342599 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.342761 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.342942 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.343208 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.343383 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.343723 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.343969 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.344313 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.344459 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.344663 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.344920 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.345064 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.345302 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.345525 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.345706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.345959 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.346102 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.346331 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.346495 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.346637 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.346952 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.347095 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.347279 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.347607 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.347789 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.347931 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.348213 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.348361 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.348544 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.348785 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.348941 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.349164 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.349358 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.349511 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.349819 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.349970 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.350140 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.350459 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.350665 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.350812 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.351093 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.351333 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.351485 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.351673 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.351819 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.352044 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.352246 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.352391 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.352841 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.352995 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.353253 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.353419 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.353590 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.353954 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.354097 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.354291 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.354606 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.354754 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.354934 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.355214 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.355371 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.355695 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.356002 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.356155 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.356337 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.356458 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.356656 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.356969 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.357107 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.357307 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.357581 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.357763 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.357953 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.358239 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.358415 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.358889 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.359175 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.359418 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.359989 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.360142 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.360402 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.360567 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.360802 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.361087 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.361233 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.361493 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.361725 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.361887 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.362167 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.362329 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.362522 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.362841 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.362986 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.363261 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.363540 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.363694 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.363931 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.364142 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.364293 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.364441 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.364581 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.364793 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.365035 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.365222 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.365521 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.365713 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.365903 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.366190 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.366342 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.366527 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.366837 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.366998 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.367160 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.367434 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.367605 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.367752 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.368016 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.368175 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.368373 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.368691 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.368882 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.369055 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.369213 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.369399 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.369744 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.369909 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.370151 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.370360 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.370510 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.370793 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.370961 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.371112 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.371415 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.371572 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.371801 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.372025 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.372224 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.372523 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.372676 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.372820 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.373152 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.373303 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.373471 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.373786 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.373953 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.374655 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.374904 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.375050 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.375486 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.375642 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.376063 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.376212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.376642 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.376899 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.377189 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.377423 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.377566 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.377815 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.378006 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.378308 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.378453 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.378609 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.378927 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.379071 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.379245 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.379549 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.379694 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.379882 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.380128 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.380273 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.380503 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.380707 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.380860 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.381116 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.381271 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.381418 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.381755 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.381906 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.382059 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.382370 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.382514 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.382683 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.382997 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.383153 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.383304 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.383575 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.383740 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.384003 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.384148 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.384295 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.384568 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.384712 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.384889 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.385210 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.385354 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.385517 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.385850 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.385997 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.386168 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.386448 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.386604 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.386788 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.387036 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.387182 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.387430 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.387610 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.387754 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.388169 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.388325 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.388488 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.388737 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.388889 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.389126 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.389300 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.389456 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.389842 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.390556 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.390838 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.391157 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.391384 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.391721 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.391877 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.392045 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.392323 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.392477 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.392720 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.392901 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.393046 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.393377 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.393530 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.393701 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.394034 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.394224 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 16:55:56.394394 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.394632 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.394807 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.394958 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.395261 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.395420 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.395594 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.395864 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.396034 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.396186 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.396475 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.396635 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.396782 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.397077 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.397243 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.397387 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.397709 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.397884 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.398037 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.398333 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.398493 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.398640 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.398929 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.399086 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.399235 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.399509 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.399670 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.399822 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.400121 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.400288 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.400439 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.400716 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.400881 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.401026 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.401310 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.401550 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.401751 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.401951 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.402188 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.402347 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.402572 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.402726 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.402917 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.403183 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.403340 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.403541 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.403819 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.403970 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.404179 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.404417 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.404577 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.404799 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.405023 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.405167 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.405975 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.406291 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.406453 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.406876 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.407032 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.407318 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.407469 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.407642 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.408019 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.408108 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.408407 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.408639 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.408787 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.409055 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.409222 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.409381 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.409729 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.409878 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.410060 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.410390 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.410554 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.410710 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.411016 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.411185 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.411333 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.411581 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.411740 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.411944 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.412138 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.412362 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.412563 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.412726 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.412868 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.413189 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.413337 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.413519 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.413877 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.414037 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.414181 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.414517 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.414711 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.414860 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.415135 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.415293 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.415484 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.415739 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.415893 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.416158 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.416308 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.416475 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.416794 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.417054 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.417198 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.417341 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103238) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 16:55:56.417491 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.417942 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.418535 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.419132 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.419770 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.420368 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.421158 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.421796 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.422408 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.423003 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.423590 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.424125 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.424651 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.425198 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.425829 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.426381 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.426952 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.427495 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.428124 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.428711 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.429339 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.429971 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.430562 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.431147 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.431748 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.432334 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.432931 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.433522 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.434151 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.434778 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.435368 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.435962 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.437117 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.437733 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.438285 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.438874 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.439471 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.440082 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.440660 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.441224 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.441869 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.442459 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.443050 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.443673 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.444298 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.444881 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.445498 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.446149 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.446741 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.447303 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.447882 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.448456 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.449030 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.449611 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.450229 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.450808 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.451397 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.451981 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.453246 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.453867 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.454477 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.455057 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.455628 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.456191 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.456764 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.457647 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.458194 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.458774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.459348 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.459887 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.460461 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.461037 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.461603 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.462203 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.462756 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.463323 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.463926 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.464524 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.465110 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.465736 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.466311 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.466923 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.467502 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.468187 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.468753 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.469344 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.470013 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.470621 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.471178 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.471713 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.472246 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.472825 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.473410 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.474026 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.474604 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.475182 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.475784 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.476378 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.476976 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.477567 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.478227 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.478818 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.479415 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.479979 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.480562 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.480720 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO dbcounter [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Registered counter for database nova_api May 18 16:55:56.481173 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.481824 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.482402 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.482999 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.484243 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.484841 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.485414 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.486032 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.486601 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.487172 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.487757 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.488358 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.488949 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.489533 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.490149 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.490715 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.491272 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.491826 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.492382 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.492952 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.493562 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.494160 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.494766 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.495371 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.495935 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.496494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.498238 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.498238 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.498446 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.498924 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.500165 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.500806 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.501372 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.501977 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.502573 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.503187 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.503760 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.503983 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_db.sqlalchemy.engines [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:55:56.504335 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.504916 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.505481 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.506112 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.506699 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.507300 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.507869 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.508539 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.508954 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.509530 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.510261 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.510842 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.511461 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.511622 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writer thread running {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:55:56.512016 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.512586 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.513160 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.513771 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.515408 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.516249 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.516840 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.517460 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.518083 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.518678 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.519286 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.519886 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.520507 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.521082 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.521650 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.522407 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.522971 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.523550 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.524132 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.524707 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.525270 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.525875 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.526446 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.527016 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.527592 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.528177 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.528788 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.529368 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.530001 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.531869 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.532492 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.533070 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.533644 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.534263 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.534852 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.535492 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.536079 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.536710 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.537334 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.538007 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.538580 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.539172 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.539787 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.540367 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.540937 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.541506 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.542135 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.542726 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.543321 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.543912 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.544496 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.545084 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.545686 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.546911 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.547494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.548067 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.548655 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.549242 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.549863 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.550446 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.551021 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.551565 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.552131 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.552722 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.553296 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.553927 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.554500 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.555077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.555648 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.556224 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.556806 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.557381 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.558022 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.558559 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.559140 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.559725 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.560318 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.560902 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.561475 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.562803 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.563361 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.563959 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.564523 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.565112 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.565710 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.566281 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.566860 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.567500 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.568017 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.568596 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.569169 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.569796 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.570380 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.570991 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.571581 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.572159 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.572720 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.573301 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.573990 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.574581 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.575237 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.575805 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.576383 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.576997 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.577683 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.578288 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.578848 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.579423 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.580012 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.580594 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.581188 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.581825 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.582657 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.582875 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.context [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d1c70ba-b105-4b40-8414-d9986bf93793(cell1) {{(pid=103238) load_cells /opt/stack/nova/nova/context.py:464}} May 18 16:55:56.583257 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.583836 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.584409 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.585003 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.585610 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.586242 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.586814 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.587399 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.587968 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.588543 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.589123 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.589727 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.589833 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 16:55:56.590314 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.590911 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.591505 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.591722 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 16:55:56.592092 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.592690 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.592817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 16:55:56.593348 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.593960 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.594526 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.595097 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.595711 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.595955 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 16:55:56.596287 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.596844 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.597394 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.597994 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.598471 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO dbcounter [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Registered counter for database nova_cell0 May 18 16:55:56.598584 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.599163 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.599986 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.600590 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.601280 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.601894 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.602475 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.603051 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.603614 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO dbcounter [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Registered counter for database nova_cell1 May 18 16:55:56.603706 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.604191 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.604737 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.605532 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.606666 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.607242 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.607508 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.608070 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.609193 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.609782 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.610625 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.611185 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.611753 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.612324 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.612938 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.613485 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.614128 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.614651 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_db.sqlalchemy.engines [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:55:56.615079 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.615565 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.616074 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.616882 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.617000 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_db.sqlalchemy.engines [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:55:56.617454 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.618065 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.618675 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.619279 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.619876 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.620452 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.621060 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.621626 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.622289 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.622893 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.623481 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.624143 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writer thread running {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:55:56.625255 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.626036 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.626655 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.627275 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.627861 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.628461 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.629267 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.629906 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.630514 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.631122 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.631693 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.632243 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.632763 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.633340 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.633919 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.634471 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.635044 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.635586 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.636162 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.636741 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.637254 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.637868 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.638450 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.639064 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.639803 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.640339 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.640802 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.641264 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.641774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.642229 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.642684 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.643128 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.643662 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.644161 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.644596 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.645081 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.645555 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.646049 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.646540 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.647067 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.647601 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.648077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.648541 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.649022 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.649488 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.650032 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.650534 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.651051 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.651612 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.652189 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.652737 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.653299 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.653908 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.654463 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.655027 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.655682 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.656285 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.656862 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.657355 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.657835 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.658272 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.658590 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.658905 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.659261 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.659575 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.659915 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.660241 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.660566 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.660901 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.661214 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.661541 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.661897 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.662220 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.662538 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.662856 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.663174 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.663491 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.663803 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.664115 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.664433 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.664750 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.665066 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.665640 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.665995 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.666311 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.666623 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.666945 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.667253 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.667564 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.667875 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.668184 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.668493 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.668802 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.669133 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.669454 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.669804 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.670144 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.670462 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.670774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.671671 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.671987 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.672355 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.672670 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.672975 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.673284 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.673598 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.673940 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.674250 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.674570 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.674869 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.675202 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.675511 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.675816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.676150 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.676430 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.676756 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.677102 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.677415 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.677752 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.678067 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.678381 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.678946 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.679259 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.679593 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.679918 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.680242 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.680557 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.680874 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.681202 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.681519 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.681852 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.682163 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.682475 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.682778 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.683097 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.683406 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.683709 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.684025 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.684330 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.684888 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.685236 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.685551 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.685904 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.686230 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.686707 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.687517 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.687841 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.688151 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.688459 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.688774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.689084 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.689387 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.689712 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.690028 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.690336 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.690640 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.690947 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.691248 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.691574 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.691879 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.692181 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.692489 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.692797 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.693097 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.693399 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.693726 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.694032 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.694340 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.694641 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.694956 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.695257 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.695559 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.695860 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.696165 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.696511 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.696834 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.697135 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.697437 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.697784 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.698097 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.698418 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.698729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.699035 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.699384 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.699698 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.700281 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.700619 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.700939 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.701282 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.701613 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.701948 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.702347 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.702696 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.702980 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.703324 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.703754 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.704067 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.704378 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.704687 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.704998 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.705307 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.705614 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.705953 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.706261 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.706570 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.706874 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.707437 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.707791 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.708111 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.708428 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.708741 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.709056 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.709366 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.709716 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.710029 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.710339 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.710654 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.710985 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.711299 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.711605 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.712034 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.712354 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.712672 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.712990 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.713300 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.713621 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.713980 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.714294 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.714612 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.714921 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.715249 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.715589 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.715915 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.716240 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.716548 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.716852 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.717155 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.717465 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.717957 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.718462 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.718892 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.719250 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.719517 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.719843 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.720133 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.720439 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.720786 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.721099 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.721404 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.721732 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.722040 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.722350 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.722654 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.722956 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.723264 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.723569 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.723871 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.724173 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.724476 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.724776 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.725113 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.725448 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.725797 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.726123 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.726438 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.726759 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.727067 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.727388 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.727711 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.728032 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.728342 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.728676 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.728985 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.729295 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.729605 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.729944 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.730254 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.730563 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.730894 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.731219 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.731524 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.731848 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.732165 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.732492 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.732807 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.733117 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.734040 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.734362 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.734669 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.734982 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.735313 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.735628 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.735938 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.736249 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.736580 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.736906 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.737215 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.737540 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.737894 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.738248 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.738560 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.738906 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.739237 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.739553 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.739867 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.740169 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 16:55:56.740413 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103237) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 16:55:56.801556 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO dbcounter [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Registered counter for database nova_api May 18 16:55:56.802816 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writer thread running {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:55:56.814930 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO dbcounter [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Registered counter for database nova_cell0 May 18 16:55:56.822512 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_db.sqlalchemy.engines [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103238) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:55:56.824844 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG oslo_db.sqlalchemy.engines [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:55:56.826941 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writer thread running {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:55:56.835779 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writer thread running {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:55:56.934541 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.context [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d1c70ba-b105-4b40-8414-d9986bf93793(cell1) {{(pid=103237) load_cells /opt/stack/nova/nova/context.py:464}} May 18 16:55:56.943677 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG oslo_concurrency.lockutils [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103237) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 16:55:56.947009 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG oslo_concurrency.lockutils [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103237) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 16:55:56.948335 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG oslo_concurrency.lockutils [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103237) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 16:55:56.951437 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG oslo_concurrency.lockutils [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103237) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 16:55:56.955886 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO dbcounter [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Registered counter for database nova_cell0 May 18 16:55:56.964138 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO dbcounter [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Registered counter for database nova_cell1 May 18 16:55:56.976973 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG oslo_db.sqlalchemy.engines [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:55:56.980189 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG oslo_db.sqlalchemy.engines [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:55:56.984670 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writer thread running {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:55:57.131002 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writer thread running {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:55:57.142495 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO dbcounter [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Registered counter for database nova_cell0 May 18 16:55:57.149903 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG oslo_db.sqlalchemy.engines [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103237) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 16:55:57.154651 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writer thread running {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 16:55:57.191225 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: WARNING keystonemiddleware.auth_token [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 16:55:57.198911 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: WARNING keystonemiddleware.auth_token [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 16:55:57.485909 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: WARNING keystonemiddleware.auth_token [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 16:55:57.493756 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: WARNING keystonemiddleware.auth_token [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 16:55:57.565085 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: WARNING keystonemiddleware.auth_token [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 16:55:57.572120 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: WARNING keystonemiddleware.auth_token [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 16:55:57.579097 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bee31549c0 pid: 103238 (default app) May 18 16:55:57.581596 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:55:57.583411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] 10.222.0.49 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002500 May 18 16:55:57.584446 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 788 bytes} [Wed May 18 16:55:57 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:55:57.851605 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: WARNING keystonemiddleware.auth_token [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 16:55:57.858011 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: WARNING keystonemiddleware.auth_token [None req-68906fd1-384f-4c66-9bc0-2d9b9d65c35b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 16:55:57.864205 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bee31549c0 pid: 103237 (default app) May 18 16:57:32.830530 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:32.831701 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 May 18 16:57:32.832344 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 2/2] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 16:57:32.851850 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writing DB stats nova_api:SELECT=3 {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:32.852881 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writing DB stats nova_cell1:SELECT=3 {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:32.853999 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writing DB stats nova_cell0:SELECT=3 {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:32.854902 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writing DB stats nova_cell0:SELECT=3 {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:33.402713 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-26584665-6b04-4eab-84a5-758cb54743a2 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:33.444234 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-26584665-6b04-4eab-84a5-758cb54743a2 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.603662 May 18 16:57:33.449052 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 1/3] 10.222.0.49 () {60 vars in 1291 bytes} [Wed May 18 16:57:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 16:57:36.434399 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:36.436041 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-f0756a19-fb4a-4e3d-8761-fba298194cf7 None None] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 May 18 16:57:36.436669 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 3/4] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:57:36.508706 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-18cb935e-bcb3-4e39-a999-cb2492e57382 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:36.529336 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 16:57:36.529336 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: warnings.warn(msg) May 18 16:57:36.563046 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-18cb935e-bcb3-4e39-a999-cb2492e57382 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.119678 May 18 16:57:36.563834 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 2/5] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:57:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:57:36.578607 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_api:SELECT=3 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:36.579599 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_cell0:SELECT=3 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:36.581156 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_cell1:SELECT=3 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:36.582082 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:57:36.800061 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-8060130c-8be1-41a8-b941-00a79756fac9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:36.802697 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 16:57:36.802697 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 18 16:57:36.889320 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-8060130c-8be1-41a8-b941-00a79756fac9 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.316412 May 18 16:57:36.897747 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 4/6] 10.222.0.49 () {64 vars in 1335 bytes} [Wed May 18 16:57:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:57:39.335145 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-18cb935e-bcb3-4e39-a999-cb2492e57382 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:39.336995 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-18cb935e-bcb3-4e39-a999-cb2492e57382 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002909 May 18 16:57:39.337924 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 3/7] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:57:39.463063 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-a30ae185-6b58-4b55-a763-85266131df88 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:39.482947 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 16:57:39.482947 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 18 16:57:39.506058 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-a30ae185-6b58-4b55-a763-85266131df88 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160290 May 18 16:57:39.506743 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 5/8] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:57:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:57:39.519427 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-f1663437-89c8-45f3-bd95-76a64e69fb5f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:39.521005 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 16:57:39.521005 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: warnings.warn(msg) May 18 16:57:39.559118 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-f1663437-89c8-45f3-bd95-76a64e69fb5f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043664 May 18 16:57:39.560825 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 4/9] 10.222.0.49 () {64 vars in 1335 bytes} [Wed May 18 16:57:39 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:57:42.745939 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-a30ae185-6b58-4b55-a763-85266131df88 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:42.748825 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-a30ae185-6b58-4b55-a763-85266131df88 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002888 May 18 16:57:42.750397 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 6/10] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:57:42.835146 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-22dbe322-ceda-4fbf-9627-1f6780af975e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "ram": 1024, "name": "ds1G", "rxtx_factor": 1.0}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:42.860290 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-22dbe322-ceda-4fbf-9627-1f6780af975e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099947 May 18 16:57:42.861472 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 5/11] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:57:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:57:42.876783 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-9e483ef5-b22d-4546-a697-983b42a1956b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:42.910137 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-9e483ef5-b22d-4546-a697-983b42a1956b admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037922 May 18 16:57:42.911660 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 7/12] 10.222.0.49 () {64 vars in 1335 bytes} [Wed May 18 16:57:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 16:57:46.382963 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-22dbe322-ceda-4fbf-9627-1f6780af975e admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:46.384264 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-22dbe322-ceda-4fbf-9627-1f6780af975e admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002325 May 18 16:57:46.384847 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 6/13] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:46 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:57:46.449033 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-8c533ee4-bb30-453c-a361-7081252749b5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:46.480616 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-8c533ee4-bb30-453c-a361-7081252749b5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.087981 May 18 16:57:46.482314 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 8/14] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:57:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:57:46.499574 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-34112983-f4b6-4613-bac1-a6fd7c2922a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:46.538872 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-34112983-f4b6-4613-bac1-a6fd7c2922a0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046198 May 18 16:57:46.538872 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 7/15] 10.222.0.49 () {64 vars in 1335 bytes} [Wed May 18 16:57:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:57:49.072064 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-8c533ee4-bb30-453c-a361-7081252749b5 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:49.074421 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-8c533ee4-bb30-453c-a361-7081252749b5 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002522 May 18 16:57:49.076462 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 9/16] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:57:49.197092 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-028034d8-601a-47d2-90b6-5130aead8a02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:49.219697 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-028034d8-601a-47d2-90b6-5130aead8a02 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.121174 May 18 16:57:49.220577 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 8/17] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:57:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:57:49.233913 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-fa03b677-1463-4c36-9a0a-2506e69633d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:49.262447 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-fa03b677-1463-4c36-9a0a-2506e69633d5 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033110 May 18 16:57:49.263574 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 10/18] 10.222.0.49 () {64 vars in 1335 bytes} [Wed May 18 16:57:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 16:57:52.495164 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-028034d8-601a-47d2-90b6-5130aead8a02 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:52.498508 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-028034d8-601a-47d2-90b6-5130aead8a02 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003875 May 18 16:57:52.499749 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 9/19] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:57:52.629560 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-a70b7151-5c01-4d19-aa48-de4846309a79 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:52.675530 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-a70b7151-5c01-4d19-aa48-de4846309a79 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.164797 May 18 16:57:52.676982 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 11/20] 10.222.0.49 () {60 vars in 1291 bytes} [Wed May 18 16:57:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 16:57:55.663349 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-028034d8-601a-47d2-90b6-5130aead8a02 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:55.664863 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-028034d8-601a-47d2-90b6-5130aead8a02 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001912 May 18 16:57:55.665714 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 10/21] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:57:55.744548 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-efb96eec-f93d-42b7-b0be-f6a2bc67d20d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "ram": 512, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "id": "1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:55.772837 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-efb96eec-f93d-42b7-b0be-f6a2bc67d20d admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.098999 May 18 16:57:55.773905 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 12/22] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:57:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:57:55.788046 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-8c5ace51-65a2-4b8e-8df7-6ce9856e8622 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:55.839912 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-8c5ace51-65a2-4b8e-8df7-6ce9856e8622 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056674 May 18 16:57:55.849695 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 11/23] 10.222.0.49 () {64 vars in 1332 bytes} [Wed May 18 16:57:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:57:58.649999 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-efb96eec-f93d-42b7-b0be-f6a2bc67d20d admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:57:58.651769 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-efb96eec-f93d-42b7-b0be-f6a2bc67d20d admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002546 May 18 16:57:58.652596 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 13/24] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:57:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:57:58.754037 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-1f07c523-2955-41cd-8f0e-c35d2cdcc9fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "swap": 0, "vcpus": 1, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:58.776432 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-1f07c523-2955-41cd-8f0e-c35d2cdcc9fc admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.113179 May 18 16:57:58.777075 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 12/25] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:57:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 16:57:58.796687 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-4071bae1-4d67-4533-b389-7d1ebd4c3896 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:57:58.837570 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-4071bae1-4d67-4533-b389-7d1ebd4c3896 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047550 May 18 16:57:58.838589 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 14/26] 10.222.0.49 () {64 vars in 1332 bytes} [Wed May 18 16:57:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 16:58:01.339297 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-1f07c523-2955-41cd-8f0e-c35d2cdcc9fc admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:01.341023 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-1f07c523-2955-41cd-8f0e-c35d2cdcc9fc admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002406 May 18 16:58:01.341785 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 13/27] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 16:58:01.416533 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-d7a9d91e-03dc-4950-a5e5-4e6c6e0b910f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:01.446519 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-d7a9d91e-03dc-4950-a5e5-4e6c6e0b910f admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.097608 May 18 16:58:01.447856 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 15/28] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:58:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 16:58:01.470924 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-c3d07e8d-e084-430f-b853-8a04790a6b29 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:01.509462 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-c3d07e8d-e084-430f-b853-8a04790a6b29 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046876 May 18 16:58:01.510378 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 14/29] 10.222.0.49 () {64 vars in 1332 bytes} [Wed May 18 16:58:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:58:04.608876 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-d7a9d91e-03dc-4950-a5e5-4e6c6e0b910f admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:04.611958 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-d7a9d91e-03dc-4950-a5e5-4e6c6e0b910f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003963 May 18 16:58:04.613069 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 16/30] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:58:04.818348 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-5cc3f3db-16fd-42c6-9596-1e0ac2024fe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "disk": 80, "vcpus": 4, "id": "4", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:04.827611 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:58:04.857867 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-5cc3f3db-16fd-42c6-9596-1e0ac2024fe0 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.233009 May 18 16:58:04.870135 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 15/31] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:58:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 16:58:04.878474 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-cde8a112-04be-48f9-94ce-d29eb5c752aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:04.928400 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-cde8a112-04be-48f9-94ce-d29eb5c752aa admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056004 May 18 16:58:04.930293 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 17/32] 10.222.0.49 () {64 vars in 1332 bytes} [Wed May 18 16:58:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:58:07.984113 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-5cc3f3db-16fd-42c6-9596-1e0ac2024fe0 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:07.986994 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-5cc3f3db-16fd-42c6-9596-1e0ac2024fe0 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003515 May 18 16:58:07.988103 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 16/33] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 16:58:08.113497 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-b496ed88-3ed5-43f1-89a9-3c3b4f1804e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:08.119965 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:58:08.138434 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-b496ed88-3ed5-43f1-89a9-3c3b4f1804e6 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.139596 May 18 16:58:08.139229 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 18/34] 10.222.0.49 () {64 vars in 1282 bytes} [Wed May 18 16:58:07 2022] POST /compute/v2.1/flavors => generated 408 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:58:08.151763 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-0d7083d3-41c2-4209-ba9c-b6c90c24d925 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:08.185550 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-0d7083d3-41c2-4209-ba9c-b6c90c24d925 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037305 May 18 16:58:08.186607 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 17/35] 10.222.0.49 () {64 vars in 1332 bytes} [Wed May 18 16:58:08 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 16:58:32.913452 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-b496ed88-3ed5-43f1-89a9-3c3b4f1804e6 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:32.914537 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-b496ed88-3ed5-43f1-89a9-3c3b4f1804e6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 May 18 16:58:32.914948 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 19/36] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:58:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:58:32.926829 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:58:32.999562 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-31e5c26a-eae3-40e5-a4fd-d297b5af9311 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:33.028536 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-31e5c26a-eae3-40e5-a4fd-d297b5af9311 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.106133 May 18 16:58:33.029392 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 18/37] 10.222.0.49 () {60 vars in 1291 bytes} [Wed May 18 16:58:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 16:58:34.151329 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-b496ed88-3ed5-43f1-89a9-3c3b4f1804e6 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:34.152453 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-b496ed88-3ed5-43f1-89a9-3c3b4f1804e6 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 May 18 16:58:34.153503 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 20/38] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 16:58:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:58:34.397653 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-ee9760d7-4b74-4e59-b61c-9885a41e748f admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:34.405190 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.wsgi [None req-ee9760d7-4b74-4e59-b61c-9885a41e748f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-ee9760d7-4b74-4e59-b61c-9885a41e748f admin admin] Request method failure captured: May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Accept: application/json May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Accept-Encoding: gzip, deflate May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Connection: keep-alive May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Content-Length: 0 May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Host: 10.222.0.49 May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Openstack-Api-Version: compute 2.90 May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Openstack-System-Scope: None May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: User-Agent: python-novaclient May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Auth-Token: gAAAAABihSW61wBNbOBv3dQ8GGQMgte-XOvM3SnhMTPAF1EZ_NGemLiMLsQz5quEhd3P5jm1lqS1kEMg0uTLH1W8qCIaoFL-cs4zxcXp0Y6EShheAZDIo4wWFvVRztoHe0QU3gs-TWLRfkEaxvEEuq9gPqX8tzvpjkhytN166BaNgyHCHOUEX10 May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Domain-Id: None May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Domain-Name: None May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Identity-Status: Confirmed May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Is-Admin-Project: True May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Openstack-Nova-Api-Version: 2.90 May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Domain-Id: default May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Domain-Name: Default May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Name: admin May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Role: admin,reader,member May 18 16:58:34.408729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Roles: admin,reader,member May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant: admin May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant-Name: admin May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User: admin May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Domain-Id: default May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Domain-Name: Default May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Id: 4f9da66f38394711b45d0352bd9b4158 May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Name: admin May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: method: > May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: exception: Flavor 42 could not be found. May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: action_args: {'id': '42'} May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 16:58:34.410774 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:34.412077 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:34.414209 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-ee9760d7-4b74-4e59-b61c-9885a41e748f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103237) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 16:58:34.416178 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-ee9760d7-4b74-4e59-b61c-9885a41e748f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070804 May 18 16:58:34.416178 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 19/39] 10.222.0.49 () {60 vars in 1190 bytes} [Wed May 18 16:58:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 18 16:58:34.423992 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-d28115e0-c5e7-4312-948b-a5d81b05f845 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:34.446571 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-d28115e0-c5e7-4312-948b-a5d81b05f845 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026550 May 18 16:58:34.447155 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 21/40] 10.222.0.49 () {60 vars in 1210 bytes} [Wed May 18 16:58:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 16:58:34.465637 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-074acaf7-6255-426d-8d67-126cbd5f0a1f admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:34.490171 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-074acaf7-6255-426d-8d67-126cbd5f0a1f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031729 May 18 16:58:34.490756 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 20/41] 10.222.0.49 () {60 vars in 1210 bytes} [Wed May 18 16:58:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 16:58:34.501188 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-dbf66ee8-0a4d-4d4b-b9c0-7685b471028c admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:34.507787 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.wsgi [None req-dbf66ee8-0a4d-4d4b-b9c0-7685b471028c admin admin] HTTP exception thrown: Flavor 42 could not be found. May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-dbf66ee8-0a4d-4d4b-b9c0-7685b471028c admin admin] Request method failure captured: May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Accept: application/json May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Accept-Encoding: gzip, deflate May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Connection: keep-alive May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Content-Length: 0 May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Host: 10.222.0.49 May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Openstack-Api-Version: compute 2.90 May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Openstack-System-Scope: None May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: User-Agent: python-novaclient May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Auth-Token: gAAAAABihSW61wBNbOBv3dQ8GGQMgte-XOvM3SnhMTPAF1EZ_NGemLiMLsQz5quEhd3P5jm1lqS1kEMg0uTLH1W8qCIaoFL-cs4zxcXp0Y6EShheAZDIo4wWFvVRztoHe0QU3gs-TWLRfkEaxvEEuq9gPqX8tzvpjkhytN166BaNgyHCHOUEX10 May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Domain-Id: None May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Domain-Name: None May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Identity-Status: Confirmed May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Is-Admin-Project: True May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Openstack-Nova-Api-Version: 2.90 May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Domain-Id: default May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Domain-Name: Default May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Name: admin May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Role: admin,reader,member May 18 16:58:34.511706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Roles: admin,reader,member May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant: admin May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant-Name: admin May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User: admin May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Domain-Id: default May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Domain-Name: Default May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Id: 4f9da66f38394711b45d0352bd9b4158 May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Name: admin May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: method: > May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: exception: Flavor 42 could not be found. May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: action_args: {'id': '42'} May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 16:58:34.513248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:34.514200 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:34.516166 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-dbf66ee8-0a4d-4d4b-b9c0-7685b471028c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 16:58:34.518330 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-dbf66ee8-0a4d-4d4b-b9c0-7685b471028c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016407 May 18 16:58:34.518330 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 22/42] 10.222.0.49 () {60 vars in 1190 bytes} [Wed May 18 16:58:34 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 16:58:35.545594 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-074acaf7-6255-426d-8d67-126cbd5f0a1f admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:35.546627 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-074acaf7-6255-426d-8d67-126cbd5f0a1f admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001552 May 18 16:58:35.547041 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 21/43] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 16:58:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:58:35.913377 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-b1d72978-4472-4c61-b29e-99ee3ba75ece admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:35.920925 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.wsgi [None req-b1d72978-4472-4c61-b29e-99ee3ba75ece admin admin] HTTP exception thrown: Flavor 84 could not be found. May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-b1d72978-4472-4c61-b29e-99ee3ba75ece admin admin] Request method failure captured: May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Accept: application/json May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Accept-Encoding: gzip, deflate May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Connection: keep-alive May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Content-Length: 0 May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Host: 10.222.0.49 May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Openstack-Api-Version: compute 2.90 May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Openstack-System-Scope: None May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: User-Agent: python-novaclient May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Auth-Token: gAAAAABihSW7kOMe3hlqg1oonyXALdrK7W51vKHTfmzkf7LPoP9veDw5uzDdx183u7zwsxjIoVDaDGAjhIUZfEbPd30qmH9uF7dJe9RqbHPeos4LEilxDSGXh6ZltYiOvF6ki8h6pLSZ0FumlDlHVVwYoLWe7tjyen8w4gsCvunzbTsh6jwHSbA May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Domain-Id: None May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Domain-Name: None May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Identity-Status: Confirmed May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Is-Admin-Project: True May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Openstack-Nova-Api-Version: 2.90 May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Domain-Id: default May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Domain-Name: Default May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Name: admin May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Role: admin,reader,member May 18 16:58:35.922525 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Roles: admin,reader,member May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant: admin May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant-Name: admin May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User: admin May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Domain-Id: default May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Domain-Name: Default May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Id: 4f9da66f38394711b45d0352bd9b4158 May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Name: admin May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: method: > May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: exception: Flavor 84 could not be found. May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: action_args: {'id': '84'} May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 16:58:35.924817 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:35.926212 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:35.928149 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-b1d72978-4472-4c61-b29e-99ee3ba75ece admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 16:58:35.930053 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-b1d72978-4472-4c61-b29e-99ee3ba75ece admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.100297 May 18 16:58:35.930053 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 23/44] 10.222.0.49 () {60 vars in 1190 bytes} [Wed May 18 16:58:35 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 16:58:35.942339 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-f11ee665-e0c0-4628-87b3-f89d20ac638c admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:35.972729 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-f11ee665-e0c0-4628-87b3-f89d20ac638c admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.038399 May 18 16:58:35.973816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 22/45] 10.222.0.49 () {60 vars in 1210 bytes} [Wed May 18 16:58:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 16:58:35.988271 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-5eb28494-f470-4db3-a4d6-7f1e927ca60b admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:36.003868 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-5eb28494-f470-4db3-a4d6-7f1e927ca60b admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019216 May 18 16:58:36.004445 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 24/46] 10.222.0.49 () {60 vars in 1210 bytes} [Wed May 18 16:58:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 16:58:36.015111 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-2145f526-a5ff-4773-8ad5-c7704b4e8514 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:36.020904 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.wsgi [None req-2145f526-a5ff-4773-8ad5-c7704b4e8514 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-2145f526-a5ff-4773-8ad5-c7704b4e8514 admin admin] Request method failure captured: May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Accept: application/json May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Accept-Encoding: gzip, deflate May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Connection: keep-alive May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Content-Length: 0 May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Host: 10.222.0.49 May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Openstack-Api-Version: compute 2.90 May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Openstack-System-Scope: None May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: User-Agent: python-novaclient May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Auth-Token: gAAAAABihSW7kOMe3hlqg1oonyXALdrK7W51vKHTfmzkf7LPoP9veDw5uzDdx183u7zwsxjIoVDaDGAjhIUZfEbPd30qmH9uF7dJe9RqbHPeos4LEilxDSGXh6ZltYiOvF6ki8h6pLSZ0FumlDlHVVwYoLWe7tjyen8w4gsCvunzbTsh6jwHSbA May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Domain-Id: None May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Domain-Name: None May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Identity-Status: Confirmed May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Is-Admin-Project: True May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Openstack-Nova-Api-Version: 2.90 May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Domain-Id: default May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Domain-Name: Default May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Name: admin May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Role: admin,reader,member May 18 16:58:36.022516 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Roles: admin,reader,member May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant: admin May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant-Name: admin May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User: admin May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Domain-Id: default May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Domain-Name: Default May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Id: 4f9da66f38394711b45d0352bd9b4158 May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Name: admin May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: method: > May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: exception: Flavor 84 could not be found. May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: action_args: {'id': '84'} May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 16:58:36.023950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:36.024870 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:36.026494 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-2145f526-a5ff-4773-8ad5-c7704b4e8514 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103237) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 16:58:36.028298 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-2145f526-a5ff-4773-8ad5-c7704b4e8514 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013268 May 18 16:58:36.028298 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 23/47] 10.222.0.49 () {60 vars in 1190 bytes} [Wed May 18 16:58:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 18 16:58:37.026917 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-5eb28494-f470-4db3-a4d6-7f1e927ca60b admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:37.028217 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-5eb28494-f470-4db3-a4d6-7f1e927ca60b admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002287 May 18 16:58:37.028706 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 25/48] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 16:58:37 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:58:37.243712 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-dc75ff8b-87b2-411b-8022-38944aa2261a admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:37.250481 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.wsgi [None req-dc75ff8b-87b2-411b-8022-38944aa2261a admin admin] HTTP exception thrown: Flavor 451 could not be found. May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-dc75ff8b-87b2-411b-8022-38944aa2261a admin admin] Request method failure captured: May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Accept: application/json May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Accept-Encoding: gzip, deflate May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Connection: keep-alive May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Content-Length: 0 May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Host: 10.222.0.49 May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Openstack-Api-Version: compute 2.90 May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Openstack-System-Scope: None May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: User-Agent: python-novaclient May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Auth-Token: gAAAAABihSW9WtE0M_QO92ALVGGPp9mbZV4JMoHHZn1EJFNDsb3H7QuS73tj1tLrRCJICFkvVGF5oG0piDnYmbV0-5apuLnMQwQVcRVlXgCxMpnRbifJGh49P9bOkxRHQFC0y-uyqJ09LCCzbZQjHSucjLRZuUEKu2oh-157hBUNHxeV1nHoScA May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Domain-Id: None May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Domain-Name: None May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Identity-Status: Confirmed May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Is-Admin-Project: True May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Openstack-Nova-Api-Version: 2.90 May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Domain-Id: default May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Domain-Name: Default May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Project-Name: admin May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Role: admin,reader,member May 18 16:58:37.252048 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Roles: admin,reader,member May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant: admin May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-Tenant-Name: admin May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User: admin May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Domain-Id: default May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Domain-Name: Default May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Id: 4f9da66f38394711b45d0352bd9b4158 May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: X-User-Name: admin May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: method: > May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: exception: Flavor 451 could not be found. May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: action_args: {'id': '451'} May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 16:58:37.254816 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:37.256467 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: ERROR nova.api.openstack.wsgi May 18 16:58:37.258497 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-dc75ff8b-87b2-411b-8022-38944aa2261a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103237) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 16:58:37.260775 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-dc75ff8b-87b2-411b-8022-38944aa2261a admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075862 May 18 16:58:37.260775 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 24/49] 10.222.0.49 () {60 vars in 1193 bytes} [Wed May 18 16:58:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 16:58:37.264470 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-650e637f-94d2-4ea8-9693-676d1aabcc87 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:37.281572 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-650e637f-94d2-4ea8-9693-676d1aabcc87 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021240 May 18 16:58:37.282180 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 26/50] 10.222.0.49 () {60 vars in 1210 bytes} [Wed May 18 16:58:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 16:58:37.292566 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:37.308391 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019651 May 18 16:58:37.309597 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 25/51] 10.222.0.49 () {60 vars in 1210 bytes} [Wed May 18 16:58:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 16:58:37.322282 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-a819d84a-45a0-4fd3-b3f4-a0d8bc6738da admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:37.329844 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.wsgi [None req-a819d84a-45a0-4fd3-b3f4-a0d8bc6738da admin admin] HTTP exception thrown: Flavor 451 could not be found. May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-a819d84a-45a0-4fd3-b3f4-a0d8bc6738da admin admin] Request method failure captured: May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Accept: application/json May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Accept-Encoding: gzip, deflate May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Connection: keep-alive May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Content-Length: 0 May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Host: 10.222.0.49 May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Openstack-Api-Version: compute 2.90 May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Openstack-System-Scope: None May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: User-Agent: python-novaclient May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Auth-Token: gAAAAABihSW9WtE0M_QO92ALVGGPp9mbZV4JMoHHZn1EJFNDsb3H7QuS73tj1tLrRCJICFkvVGF5oG0piDnYmbV0-5apuLnMQwQVcRVlXgCxMpnRbifJGh49P9bOkxRHQFC0y-uyqJ09LCCzbZQjHSucjLRZuUEKu2oh-157hBUNHxeV1nHoScA May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Domain-Id: None May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Domain-Name: None May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Identity-Status: Confirmed May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Is-Admin-Project: True May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Openstack-Nova-Api-Version: 2.90 May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Domain-Id: default May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Domain-Name: Default May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Project-Name: admin May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Role: admin,reader,member May 18 16:58:37.331411 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Roles: admin,reader,member May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/a76edbb694024faba6c3d4a9e9057ee3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant: admin May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant-Id: a76edbb694024faba6c3d4a9e9057ee3 May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-Tenant-Name: admin May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User: admin May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Domain-Id: default May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Domain-Name: Default May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Id: 4f9da66f38394711b45d0352bd9b4158 May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: X-User-Name: admin May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: method: > May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: exception: Flavor 451 could not be found. May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: action_args: {'id': '451'} May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 16:58:37.333936 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:37.335608 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: ERROR nova.api.openstack.wsgi May 18 16:58:37.337890 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-a819d84a-45a0-4fd3-b3f4-a0d8bc6738da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103238) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 16:58:37.340085 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-a819d84a-45a0-4fd3-b3f4-a0d8bc6738da admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.015900 May 18 16:58:37.340085 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 27/52] 10.222.0.49 () {60 vars in 1193 bytes} [Wed May 18 16:58:37 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 18 16:58:38.325933 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:38.327745 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002034 May 18 16:58:38.328371 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 26/53] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 16:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:58:38.561546 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-f46aab25-5945-4a4b-a821-ec01436a3448 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:38.582277 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-f46aab25-5945-4a4b-a821-ec01436a3448 admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.097156 May 18 16:58:38.582827 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 28/54] 10.222.0.49 () {64 vars in 1235 bytes} [Wed May 18 16:58:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:58:39.536483 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:39.537730 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001639 May 18 16:58:39.538216 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 27/55] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 16:58:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:58:39.754741 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-fe701d96-bc35-4b81-a573-823a8d99d62e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:39.778507 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-fe701d96-bc35-4b81-a573-823a8d99d62e admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.095829 May 18 16:58:39.779355 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 29/56] 10.222.0.49 () {64 vars in 1235 bytes} [Wed May 18 16:58:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 16:58:40.795151 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:40.796173 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 May 18 16:58:40.796580 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 28/57] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 16:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 16:58:41.001290 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-da786c8b-6128-4577-b5c0-87f6a8672fcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:41.022444 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-da786c8b-6128-4577-b5c0-87f6a8672fcb admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.087266 May 18 16:58:41.023136 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 30/58] 10.222.0.49 () {64 vars in 1235 bytes} [Wed May 18 16:58:40 2022] POST /compute/v2.1/flavors => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 16:58:42.433950 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:42.435039 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001677 May 18 16:58:42.435502 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 29/59] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 16:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 16:58:42.645499 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-a3923e45-5c1d-499e-a931-c8a7733c7c4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 16:58:42.666584 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-a3923e45-5c1d-499e-a931-c8a7733c7c4c admin admin] 10.222.0.49 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.089711 May 18 16:58:42.667153 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 31/60] 10.222.0.49 () {64 vars in 1235 bytes} [Wed May 18 16:58:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 16:58:43.643551 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:43.645449 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002843 May 18 16:58:43.646385 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 30/61] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 16:58:43 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:58:43.975222 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-4a7efeea-bea6-410c-8a16-5ae26e3ed2cb admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:58:44.010989 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-4a7efeea-bea6-410c-8a16-5ae26e3ed2cb admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.100358 May 18 16:58:44.012558 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 32/62] 10.222.0.49 () {60 vars in 1202 bytes} [Wed May 18 16:58:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 16:59:52.805812 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:59:52.806885 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-624f348e-82f3-4736-96e4-7f3006b76409 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 May 18 16:59:52.808046 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 31/63] 10.222.0.49 () {54 vars in 930 bytes} [Wed May 18 16:59:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 16:59:52.816624 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:59:52.880677 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-e3189d14-fe2e-4b3c-aa18-307439749c7f admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:59:52.902930 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-e3189d14-fe2e-4b3c-aa18-307439749c7f admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.087763 May 18 16:59:52.903491 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 33/64] 10.222.0.49 () {60 vars in 1291 bytes} [Wed May 18 16:59:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 16:59:52.925062 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG dbcounter [-] [103237] Writing DB stats nova_api:SELECT=14 {{(pid=103237) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 16:59:52.931836 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-5dca919b-d630-4054-9709-d9b65a7dae4d admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:59:52.946335 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-5dca919b-d630-4054-9709-d9b65a7dae4d admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.023257 May 18 16:59:52.947322 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 32/65] 10.222.0.49 () {60 vars in 1282 bytes} [Wed May 18 16:59:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:59:52.965362 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-2d7edffc-7108-4abe-a2b2-e812fef98470 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:59:52.974461 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-2d7edffc-7108-4abe-a2b2-e812fef98470 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013462 May 18 16:59:52.975102 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 34/66] 10.222.0.49 () {60 vars in 1285 bytes} [Wed May 18 16:59:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:59:52.988090 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:59:52.996566 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012269 May 18 16:59:52.997151 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 33/67] 10.222.0.49 () {60 vars in 1285 bytes} [Wed May 18 16:59:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 16:59:53.009546 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-f482e4e0-cbd4-4e5d-b2a0-835d3b9bf1e4 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 16:59:53.018850 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-f482e4e0-cbd4-4e5d-b2a0-835d3b9bf1e4 admin admin] 10.222.0.49 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013167 May 18 16:59:53.019417 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 35/68] 10.222.0.49 () {60 vars in 1282 bytes} [Wed May 18 16:59:53 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:03:43.316335 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:03:43.317459 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 May 18 17:03:43.317863 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 34/69] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 17:03:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:03:43.477729 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_api:SELECT=6 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:03:43.612939 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-fd14426b-5caa-49da-a37b-30d1a035195d admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:03:43.614207 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 17:03:43.614207 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 18 17:03:43.615943 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-fd14426b-5caa-49da-a37b-30d1a035195d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:03:43.616393 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-fd14426b-5caa-49da-a37b-30d1a035195d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:03:43.617182 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-fd14426b-5caa-49da-a37b-30d1a035195d admin admin] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:03:43.617613 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-fd14426b-5caa-49da-a37b-30d1a035195d admin admin] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:03:43.654217 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-fd14426b-5caa-49da-a37b-30d1a035195d admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.177837 May 18 17:03:43.654809 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 36/70] 10.222.0.49 () {60 vars in 1193 bytes} [Wed May 18 17:03:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 18 17:03:44.623352 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:03:44.624399 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 18 17:03:44.625117 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 35/71] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 17:03:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:03:44.823331 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-8543521c-f17b-427c-bfb4-acf4363082a2 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:03:44.824431 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 17:03:44.824431 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 18 17:03:44.825606 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-8543521c-f17b-427c-bfb4-acf4363082a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:03:44.826067 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-8543521c-f17b-427c-bfb4-acf4363082a2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:03:44.826844 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-8543521c-f17b-427c-bfb4-acf4363082a2 admin admin] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:03:44.827272 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-8543521c-f17b-427c-bfb4-acf4363082a2 admin admin] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:03:44.847972 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-8543521c-f17b-427c-bfb4-acf4363082a2 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081355 May 18 17:03:44.848550 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 37/72] 10.222.0.49 () {60 vars in 1193 bytes} [Wed May 18 17:03:44 2022] GET /compute/v2.1/os-services => generated 794 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:03:56.229145 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:03:56.230237 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 May 18 17:03:56.230631 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 36/73] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 17:03:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:03:56.382711 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_cell0:SELECT=4 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:03:56.383363 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_cell1:SELECT=4 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:03:56.383978 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG dbcounter [-] [103238] Writing DB stats nova_api:SELECT=8 {{(pid=103238) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:03:56.445339 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-2dd76e83-e867-42ed-b449-559f3b0431f5 admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:03:56.447705 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 17:03:56.447705 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 18 17:03:56.450039 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-2dd76e83-e867-42ed-b449-559f3b0431f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:03:56.450828 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-2dd76e83-e867-42ed-b449-559f3b0431f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:03:56.452189 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-2dd76e83-e867-42ed-b449-559f3b0431f5 admin admin] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:03:56.452935 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-2dd76e83-e867-42ed-b449-559f3b0431f5 admin admin] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:03:56.489079 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-2dd76e83-e867-42ed-b449-559f3b0431f5 admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.111778 May 18 17:03:56.490451 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 38/74] 10.222.0.49 () {60 vars in 1193 bytes} [Wed May 18 17:03:56 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:03:57.431078 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: DEBUG nova.api.openstack.wsgi [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] Calling method '>' {{(pid=103237) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:03:57.432119 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: INFO nova.api.openstack.requestlog [None req-db3818a3-a720-499c-bd4b-9944f45dfa31 admin admin] 10.222.0.49 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 May 18 17:03:57.432531 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: [pid: 103237|app: 0|req: 37/75] 10.222.0.49 () {56 vars in 1074 bytes} [Wed May 18 17:03:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:03:57.629747 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG nova.api.openstack.wsgi [None req-8f04ed04-91af-4ada-8774-d1355d90991b admin admin] Calling method '>' {{(pid=103238) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:03:57.631749 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 18 17:03:57.631749 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: warnings.warn(msg) May 18 17:03:57.632971 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-8f04ed04-91af-4ada-8774-d1355d90991b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:03:57.633412 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-8f04ed04-91af-4ada-8774-d1355d90991b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:03:57.634248 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-8f04ed04-91af-4ada-8774-d1355d90991b admin admin] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:03:57.634678 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: DEBUG oslo_concurrency.lockutils [None req-8f04ed04-91af-4ada-8774-d1355d90991b admin admin] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103238) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:03:57.656820 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: INFO nova.api.openstack.requestlog [None req-8f04ed04-91af-4ada-8774-d1355d90991b admin admin] 10.222.0.49 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.081624 May 18 17:03:57.657308 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: [pid: 103238|app: 0|req: 39/76] 10.222.0.49 () {60 vars in 1193 bytes} [Wed May 18 17:03:57 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:04:57.153958 dv-cinder-795785-11-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 18 17:04:57.154901 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: Wed May 18 17:04:57 2022 - graceful shutdown triggered... May 18 17:04:57.155409 dv-cinder-795785-11-iscsi devstack@n-api.service[103237]: Gracefully killing worker 1 (pid: 103237)... May 18 17:04:57.155772 dv-cinder-795785-11-iscsi devstack@n-api.service[103238]: Gracefully killing worker 2 (pid: 103238)... May 18 17:04:58.156050 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: worker 1 buried after 1 seconds May 18 17:04:58.156050 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: worker 2 buried after 1 seconds May 18 17:04:58.156050 dv-cinder-795785-11-iscsi devstack@n-api.service[103236]: goodbye to uWSGI. May 18 17:04:58.157833 dv-cinder-795785-11-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 18 17:04:58.158471 dv-cinder-795785-11-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 18 17:04:58.161640 dv-cinder-795785-11-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 18 17:04:58.177112 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 18 17:04:58 2022] *** May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: nodename: dv-cinder-795785-11-iscsi May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: machine: x86_64 May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: clock source: unix May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: pcre jit disabled May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: detected number of CPU cores: 4 May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: current working directory: / May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: detected binary path: /usr/bin/uwsgi-core May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: your processes number limit is 47680 May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: your memory page size is 4096 bytes May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: detected max file descriptor number: 2048 May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: lock engine: pthread robust mutexes May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: thunder lock: enabled May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 18 17:04:58.198875 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 18 17:04:58.249239 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: Python main interpreter initialized at 0x5598369a59c0 May 18 17:04:58.249239 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: python threads support enabled May 18 17:04:58.249239 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: your server socket listen backlog is limited to 100 connections May 18 17:04:58.249239 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: your mercy for graceful operations on workers is 90 seconds May 18 17:04:58.249744 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: mapped 403077 bytes (393 KB) for 2 cores May 18 17:04:58.249744 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: *** Operational MODE: preforking *** May 18 17:04:58.249981 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: *** uWSGI is running in multiple interpreter mode *** May 18 17:04:58.249981 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: spawned uWSGI master process (pid: 117709) May 18 17:04:58.250193 dv-cinder-795785-11-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 18 17:04:58.252192 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: spawned uWSGI worker 1 (pid: 117731, cores: 1) May 18 17:04:58.252192 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: spawned uWSGI worker 2 (pid: 117732, cores: 1) May 18 17:04:58.252192 dv-cinder-795785-11-iscsi devstack@n-api.service[117709]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 18 17:04:59.486808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 17:04:59.554312 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 18 17:05:00.322106 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 17:05:00.322106 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: from cryptography.utils import int_from_bytes May 18 17:05:00.322406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 17:05:00.322406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: from cryptography.utils import int_from_bytes May 18 17:05:00.322544 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 17:05:00.322544 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: from cryptography.utils import int_from_bytes May 18 17:05:00.322685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 18 17:05:00.322685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: from cryptography.utils import int_from_bytes May 18 17:05:02.803340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 17:05:02.804564 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 17:05:02.804564 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 17:05:02.804564 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 17:05:02.804873 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 17:05:02.805188 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.805396 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.805696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.806014 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.806342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.806651 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.806969 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.807287 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.807615 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.807872 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.808187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.808512 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-11-iscsi {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.808835 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.809144 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.809466 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.809804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.810107 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.811037 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.811338 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.811845 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.813302 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.813302 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.813302 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.813555 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.813854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.814177 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.814479 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.814781 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.815110 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.815431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.815832 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-11-iscsi {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.816139 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.816446 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.816755 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.817166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.817488 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.817808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.818139 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.818451 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.818760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.819112 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.819438 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.819730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.820048 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.820350 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.820653 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.820962 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.821281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.821583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.821928 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.822175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.822483 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.822805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.823124 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.823448 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.823699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.823987 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.824270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.824589 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.824897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.825195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.825493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.825904 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.826704 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.826984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.827291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.827592 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.827909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.828226 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.828547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.828854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.829173 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.829579 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.829854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.830164 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.830507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.830825 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.831133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.831454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.831776 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.832085 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.832390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.832696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.833012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.833344 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.833648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.833917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.834219 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.834523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.834882 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.835312 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.835828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.836376 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.836684 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.838707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.838707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.838707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.838707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.839413 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.839413 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.839721 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.840255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.840629 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.840970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.841377 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.841938 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.842259 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.842570 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.842886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.843793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.843793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.843793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.844224 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.844430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.844738 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.845058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.845512 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.845738 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.846014 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.846315 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.846623 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.846943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.847253 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.847560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.847863 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.848165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.848468 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.848770 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.849072 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.849413 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.849732 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.850064 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.850522 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.850812 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.851114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.851475 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.851812 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.852170 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.852481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 18 17:05:02.852983 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.853144 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 18 17:05:02.853290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.853290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.853594 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 18 17:05:02.853790 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.853941 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 18 17:05:02.854094 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.854247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 18 17:05:02.854399 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.854554 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.854710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.854877 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.855032 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.855177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.855556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.855737 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.855902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.856070 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.856218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.856464 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.856614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.856769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.857198 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.857460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.857628 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.857842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.857990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.858159 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.858306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.858619 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.858771 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.859131 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-795785-11-iscsi {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.859238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.859238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.859440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.859640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.859742 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.859834 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.859935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.860021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.860021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.860181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.860270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.860356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.863112 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.863241 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.863334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.863428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.863521 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.863521 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.863706 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.863819 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.863906 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.863989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.864073 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.864166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.864256 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.864348 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.864432 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.864515 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.864605 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.864704 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.864789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.864883 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.864975 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.865065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.865163 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.865249 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.865339 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.865447 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.865541 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.865632 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.865741 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-795785-11-iscsi {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.865836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.865927 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.866223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.866330 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.866444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.866540 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.866634 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.866634 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.866796 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.866887 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.866981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.867073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.867158 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.867250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.867250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.867431 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.867526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.867788 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.867902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.868089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.868218 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.868396 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.868552 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.868700 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.868980 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.869079 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.869324 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.869430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.869630 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.869758 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.869984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.870084 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.870289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.870421 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.870598 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.870912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.871003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.871220 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.871337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.871536 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.871641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.871821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.871923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.872130 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.872234 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.872435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.872566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.873577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.873737 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.873815 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.873985 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.874120 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.874220 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.874467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.874565 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.874746 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.874838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.875069 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.875160 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.875385 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.875476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.875696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.875793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.876007 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.876115 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.876356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.876469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.876617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.876718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.876923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.877021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.877230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.877335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.877537 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.877629 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.877876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.877970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.878197 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.878304 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.878506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.878604 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.878889 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.879002 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.879135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.879242 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.879547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.879668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.879756 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.879849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.49 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.880074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.880185 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.49 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.880353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.880513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.880659 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.880871 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.880986 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.881087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.881266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.881417 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.881571 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.882087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.882202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.882279 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.882360 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.882441 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.882523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.882603 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.882779 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.882931 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.883168 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.883508 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.883686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.883812 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.884104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.884255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.884410 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.884575 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.884716 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.884887 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.885036 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.885198 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.885343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.885550 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.885639 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.885885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.885968 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.886234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.886326 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.886578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.886780 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.886900 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.887108 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.887227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.887433 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.887579 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.887758 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.888045 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.888140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.889853 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.889853 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.890085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.890176 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.890176 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.890176 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.890513 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.890767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.891000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.891149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.891411 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.891726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.891902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.892302 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.892410 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.892489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.892636 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.892747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.892987 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.893105 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.893326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.893431 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.893643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.893791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.893993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.894095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.894305 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.894400 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.894621 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.894709 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.894935 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.895050 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.895248 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.895358 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.895559 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.895662 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.895869 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.895979 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.896191 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.896293 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.896503 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.896603 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.896824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.896927 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.897135 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.897237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.897459 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.897552 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.897821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.897942 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.898143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.898236 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.898497 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.898588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.898815 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.898916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.899141 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.899231 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.899472 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.899641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.899803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.900088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.900265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.900429 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.900593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.900783 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.901092 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.901417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.901417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.901779 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.901891 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.901989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.902091 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.902185 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.902279 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.902523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.902819 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.903129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.903373 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.903474 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.903715 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.903808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.904283 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.904562 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.904661 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.904771 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.904854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.905114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.905217 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.905440 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.905753 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 18 17:05:02.905852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.906089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.906354 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.906459 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.906702 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.906801 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.907017 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.907218 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.907335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.907438 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.907630 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.907736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.907937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.908121 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.908272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.908571 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.908790 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.909017 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.909250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.909485 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.909642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.909782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.909985 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.910086 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.910241 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.910388 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.910521 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.910660 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.910757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.910923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.911012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.911085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.911196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.911569 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.911716 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.911851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.912014 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.912523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.912681 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.912833 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.912988 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.913145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.913290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.913439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.913592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.913781 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.913935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.914092 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.914233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.914439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.914647 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.914788 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.915583 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.915749 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.915938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.916113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.916257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.916458 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.916601 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.916741 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.916880 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.917030 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.917171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.917171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.917378 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.917453 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.917679 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.917827 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.917966 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.918109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.918246 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.918384 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.918535 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.918692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.918832 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.918979 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.919119 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.919265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.919421 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.919606 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.919748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920283 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920380 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920557 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920652 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920745 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.920921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921091 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921164 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921255 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921433 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921896 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.921980 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.922064 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.922153 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.922245 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.922410 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.922617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.922792 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.922969 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.923125 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.923296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.923471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.923631 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.923799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.923968 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.924137 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.924356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.924545 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.924738 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.924900 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.925071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.925268 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.925896 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.926134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.926371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.926601 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.926841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.927079 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.927319 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.927592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.927840 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.928079 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.928316 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.928543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.928787 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.929010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.929241 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.929462 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.929731 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.929987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.930209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.930445 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.930686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.930936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.931205 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.931442 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.931682 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.931841 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.931989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.932137 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.932286 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.932447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.932589 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.932720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.932865 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.933004 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.933153 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.933314 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.933472 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.933616 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.933942 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.934484 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.934758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.934913 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.935059 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.935721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.935900 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.936207 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.936378 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.936534 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.936685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.936843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.937013 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.937171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.937347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.937514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.937753 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.937921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.938073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.938239 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.938418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.938572 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.938737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.938922 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.939434 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.939615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.939782 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.939949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.940114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.940283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.940439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.940607 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.940762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.940929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.941094 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.941260 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.941511 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.941803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.941961 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.942130 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.942299 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.942456 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.942623 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.942786 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.942942 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.943097 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.943261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.943417 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.943594 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.943765 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.944111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.944280 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.944450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.944450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.944770 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.944917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.945073 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.945227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.945391 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.945556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.945776 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.945929 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.946095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.946262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.946447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.946886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.947063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.947230 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.947385 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.947543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.947696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.947859 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.948006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.948145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.948285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.948439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.948591 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.948750 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.948917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.949087 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.949250 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.949406 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.949563 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.949763 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.949933 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.950082 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.950233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.950385 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.950549 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.950702 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.951472 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.951638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.951785 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.951928 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.952085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.952249 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.952412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.952576 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.952734 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.952887 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.953065 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.953230 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.953385 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.953548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.953799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.954319 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.954499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.954674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.954821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.954975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.955119 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.955280 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.955450 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.955609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.955760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.955909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.956064 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.956236 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.956392 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.956545 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.956706 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.956862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.957015 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.957186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.957342 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.957493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.957645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.957839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.957968 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.958134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.958285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.958285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.958570 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.958715 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.958864 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.959037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.959192 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.959354 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.959514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.959665 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.959820 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.959979 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.960134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.960282 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.960446 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.960609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.960782 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.960946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.961095 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.961259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.961410 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.961571 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.961804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.961966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.962141 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.962306 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.962703 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.962856 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.963074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.963244 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.963402 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.963567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.963744 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.963902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.964062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.964223 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.964392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.964545 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.964696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.964864 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.965014 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.965160 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.965311 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.965466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.965634 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.965852 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.965991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.966137 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.966137 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.966521 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.966713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.966864 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.966998 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.967149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.967301 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.967456 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.967630 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.967796 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.967965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.968123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.968275 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.968432 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.968617 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.968773 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.968931 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.969096 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.969252 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.969418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.969589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.969785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.969940 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.970092 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.970259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.970425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.970693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.970850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.971020 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.971172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.971328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.971492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.971656 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.971811 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.971956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.972114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.972265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.972442 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.972619 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.972782 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.972936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.973107 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.973273 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.973492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.973777 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.973948 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.974111 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.974273 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.974420 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.974574 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.974725 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.974884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.975035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.975035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.975360 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.975360 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.975625 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.976727 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.976906 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.977065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.977236 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.977394 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.977566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.977823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.977986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.978144 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.978144 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.978459 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.978627 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.978783 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.978947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.979116 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.979376 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.979536 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.979686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.979862 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.980019 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.980192 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.980362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.980520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.980690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.980861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.981016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.981168 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.981322 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.981471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.981471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.981804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.981961 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.982635 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.982792 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.982947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.983117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.983267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.983419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.983570 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.983712 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.983863 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.984041 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.984205 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.984360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.984508 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.984674 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.984839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.985016 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.985178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.985334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.985493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.985649 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.985952 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.986142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.986309 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.986474 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.986636 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.986790 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.986962 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.987117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.987266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.987417 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.987582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.987747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.987925 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.988079 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.988247 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.988401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.988567 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.988720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.988890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.989056 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.989221 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.989367 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.989528 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.989755 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.989934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.990093 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.990261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.990417 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.990584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.990756 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.990912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.991067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.991232 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.991396 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.991550 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.991709 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.991709 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.991999 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.992154 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.992294 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.992436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.992546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.992670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.992758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.992845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.992930 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.993014 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.993158 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.993315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.993475 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.993643 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.993814 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.993916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994004 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994078 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994221 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994392 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994631 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994710 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994888 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.994981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995158 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995239 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995323 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995416 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995497 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995669 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.995939 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996031 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996115 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996198 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996281 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996381 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996474 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996795 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.996971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.997054 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.997145 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.997229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.997314 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.997406 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.997480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.997559 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.998498 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.998645 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.998645 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.998882 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.998968 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.998968 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999181 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999266 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999503 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999575 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999645 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999728 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999802 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999873 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:02.999950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000029 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000101 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000344 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000681 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000860 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.000944 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001214 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001388 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001388 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001650 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001764 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.001945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002039 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002138 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002394 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002598 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002847 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.002933 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003005 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003086 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003173 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003257 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003446 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003532 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003612 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003768 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003852 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.003943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004042 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004042 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004281 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004438 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004535 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004620 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004788 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004873 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.004972 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005159 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005243 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005327 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005419 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005904 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.005976 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.006210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.006314 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.006519 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.006623 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.006827 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.006921 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.007138 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.007230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.007446 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.007546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.007754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.007847 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.008062 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.008171 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.008373 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.008488 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.008679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.008774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.008992 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.009095 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.009303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.009443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.009610 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.009790 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.009955 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.010083 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.010262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.010371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.010572 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.010749 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.010910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.011115 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.011255 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.011431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.011570 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.011760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.011925 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.012079 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.012220 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.012392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.012539 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.012711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.012859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.013032 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.013172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.013371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.013508 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.013779 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.013899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.014067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.014168 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.014376 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.014467 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.014685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.014787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.014990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.015185 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.015312 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.015502 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.015653 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.015815 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.016030 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.016131 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.016357 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.016449 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.016667 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.016760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.017012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.017206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.017338 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.017556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.017680 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.017898 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.018261 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.018358 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.018444 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.018543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.018631 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.018840 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.018933 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.019146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.019239 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.019485 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.019640 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.019785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.019877 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.020089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.020185 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.020402 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.020587 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.020711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.020900 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.021020 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.021217 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.021401 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.021538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.021752 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.021883 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.021978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.022208 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.022310 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.022514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.022616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.022819 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.022911 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.023128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.023220 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.023439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.023530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.023748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.023854 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.024052 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.024160 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.024362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.024451 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.024665 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.024755 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.024967 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.025060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.025272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.025374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.025572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.025700 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.025907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.025996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.026213 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.026365 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.026520 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.026691 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.026822 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.027004 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.027130 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.027328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.027421 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.027658 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.027753 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.028021 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.028112 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.028331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.028425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.028644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.028748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.029062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.029168 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.029379 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.029475 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.029711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.029833 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.030030 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.030144 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.030341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.030456 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.030650 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.030743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.031025 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.031152 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.031251 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.031354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.031553 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.031848 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.031952 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.032168 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.032260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.032486 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.032580 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.032798 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.032889 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.033122 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.033242 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.033434 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.033538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.033768 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.033894 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.034089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.034343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.034563 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.034730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.034884 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.035044 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.035195 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.035352 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.035504 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.035649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.035649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.035932 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.036076 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.036306 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.036449 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.037769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.037870 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.037949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038032 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038190 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038264 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038345 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038426 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038509 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038583 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038663 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038744 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038818 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.038929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039100 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039173 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039256 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.039893 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.040106 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.040229 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.040409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.040494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.040717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.040809 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.041025 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.041159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.041331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.041558 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.041732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.041844 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.041952 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.042042 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.042261 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.042415 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.042579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.042683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.042890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.043012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.043195 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.043299 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.043499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.043679 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.043795 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.043892 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.044135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.044227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.044439 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.045044 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.045295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.045458 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.045606 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.045816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.045972 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.046123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.046290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.046415 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.046674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.046779 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.047005 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.047116 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.047356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.047461 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.047667 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.047761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.047973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.048085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.048280 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.048381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.048590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.048684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.048910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.049023 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.049221 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.049323 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.049526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.049637 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.049854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.049964 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.050162 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.050264 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.050469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.050570 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.050775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.051038 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.051140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.051369 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.051481 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.051687 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.051957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.052189 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.052416 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.052639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.052872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.053110 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.053423 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.053713 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.053939 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.054168 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.054361 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.054514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.054769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.054914 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.055063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.055198 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.055343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.055505 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.055654 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.055810 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.055965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.056107 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.056248 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.056411 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.056578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.056720 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.056877 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.057017 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.057166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.057313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.057783 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.057945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.058082 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.058339 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.058495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.058634 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.058766 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.058912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.059058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.059222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.059335 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.059420 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.059513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.059586 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.059693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.059852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.060915 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.061055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.061133 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.061205 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.061309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.061486 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.061640 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.062390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.062481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.062556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.062628 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.062714 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.062789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.062871 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.062952 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063245 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063604 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063678 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063756 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063835 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.063914 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.064034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.064113 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.064263 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.064356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.064574 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.064671 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.064920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.065031 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.065196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.065310 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.065504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.065743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.065824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.065967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.068207 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.068418 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.068514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.068613 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.068701 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.068786 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.068877 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.068964 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069175 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069268 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069368 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069455 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069549 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069637 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069748 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069835 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.069921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.070367 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.070480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.070571 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.070654 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.070740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.070740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.070904 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.070998 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.071094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.071177 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117732) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 17:05:03.071262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.071262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.071262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.071571 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.071825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.072157 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.072468 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.072777 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.073100 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.073411 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.073744 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.074052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.074366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.074678 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.074989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.075301 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.075609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.075973 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.076280 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.076591 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.076999 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.077310 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.077618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.077952 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.078260 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.078565 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.078881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.079192 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.079501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.079808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.080121 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.080430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.080740 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.081095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.081427 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.081756 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.082069 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.082387 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.082703 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.083028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.083348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.083663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.084007 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.084326 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.084896 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.085232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.085551 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.085920 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.086253 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.086569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.086873 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.087181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.087759 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.088074 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.088386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.088696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.089010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.089319 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.089629 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.089959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.090268 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.090576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.090883 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.091192 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.091649 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.092103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.092595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.092925 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.093245 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.093566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.093912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.094227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.094538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.094886 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.095240 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.095475 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.095808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.096124 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.096433 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.096865 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.097179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.097501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.097847 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.098174 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.098487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.098824 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.099123 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.099444 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.099752 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.100080 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.100422 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.100750 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.101075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.101381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.101733 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.102011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.102320 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.102639 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.102948 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.103250 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.103553 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.103861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.104164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.104468 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.104772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.105074 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.105381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.105739 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.106019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.106325 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.106631 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.107515 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.108153 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.108470 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.108781 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.109088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.109395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.109726 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.110067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.110379 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.110717 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.111035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.111704 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.111704 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.112156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.112319 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.112600 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.112919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.113238 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.113552 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.113922 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.114236 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.114548 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.114862 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.115175 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.115481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.115794 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.116140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.116449 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.117076 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.117386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.117732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.118093 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.118382 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.118703 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.119042 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.119327 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.119644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.119979 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.120274 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.120585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.120923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.121255 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.121532 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.121929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.122203 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.122550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.123663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.124175 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.124438 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.124791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.125128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.125448 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.125791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.126103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 18 17:05:03.126351 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117731) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 18 17:05:03.132417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO dbcounter [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Registered counter for database nova_api May 18 17:05:03.153726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_db.sqlalchemy.engines [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 17:05:03.161058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writer thread running {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 17:05:03.187319 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO dbcounter [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Registered counter for database nova_api May 18 17:05:03.208068 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_db.sqlalchemy.engines [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 17:05:03.216460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writer thread running {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 17:05:03.221983 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.context [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d1c70ba-b105-4b40-8414-d9986bf93793(cell1) {{(pid=117732) load_cells /opt/stack/nova/nova/context.py:464}} May 18 17:05:03.226628 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:05:03.228546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:05:03.229380 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:05:03.231735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:05:03.234402 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO dbcounter [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Registered counter for database nova_cell0 May 18 17:05:03.238888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO dbcounter [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Registered counter for database nova_cell1 May 18 17:05:03.246783 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_db.sqlalchemy.engines [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 17:05:03.248794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_db.sqlalchemy.engines [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 17:05:03.256157 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writer thread running {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 17:05:03.257427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writer thread running {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 17:05:03.279365 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.context [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0d1c70ba-b105-4b40-8414-d9986bf93793(cell1) {{(pid=117731) load_cells /opt/stack/nova/nova/context.py:464}} May 18 17:05:03.284208 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:05:03.285897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:05:03.286836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:05:03.288859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:05:03.290946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO dbcounter [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Registered counter for database nova_cell0 May 18 17:05:03.295767 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO dbcounter [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Registered counter for database nova_cell1 May 18 17:05:03.303937 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_db.sqlalchemy.engines [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 17:05:03.305242 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_db.sqlalchemy.engines [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 17:05:03.313550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writer thread running {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 17:05:03.313916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writer thread running {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 17:05:03.412547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO dbcounter [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Registered counter for database nova_cell0 May 18 17:05:03.420377 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_db.sqlalchemy.engines [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117732) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 17:05:03.425703 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writer thread running {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 17:05:03.473635 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO dbcounter [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Registered counter for database nova_cell0 May 18 17:05:03.481192 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_db.sqlalchemy.engines [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117731) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 18 17:05:03.486647 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writer thread running {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 18 17:05:03.752178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: WARNING keystonemiddleware.auth_token [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 17:05:03.759794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: WARNING keystonemiddleware.auth_token [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 17:05:03.818418 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: WARNING keystonemiddleware.auth_token [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 17:05:03.827040 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: WARNING keystonemiddleware.auth_token [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 17:05:04.115830 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: WARNING keystonemiddleware.auth_token [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 17:05:04.123330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: WARNING keystonemiddleware.auth_token [None req-90559869-9117-42ae-a776-ac37f03ecf83 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 17:05:04.128951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598369a59c0 pid: 117732 (default app) May 18 17:05:04.183872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: WARNING keystonemiddleware.auth_token [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 18 17:05:04.191198 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: WARNING keystonemiddleware.auth_token [None req-bacff821-0ec9-4fd6-8b81-07ef8f8021cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 18 17:05:04.196587 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598369a59c0 pid: 117731 (default app) May 18 17:05:48.847537 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:48.850155 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:48.853502 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:48.856931 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:49.276962 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:49.281121 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:49.285608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:49.289982 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:05:50.925116 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-266e82ed-2253-443f-8fbc-6533eb2bb428 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Action: 'create', calling method: .version_select at 0x7fef01b0b3a0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1284528990", "metadata": {"Type": "work"}}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-266e82ed-2253-443f-8fbc-6533eb2bb428 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Request method failure captured: May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 122 May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdsDCaMiWvkKePjRP7jqzxeGo4l7EACS7iR7RF3VVKwn5r2aSKbq2pqoJZEhQ7qChHNuqdm6JkTRTSoWJPpqD-70j9Lhbf6jLul8E-V92GGUAlu21gzDc5vRo7oAc8n_JjNqf-3kV8zni_zJhBcx9iDo9CD3bSLtR7mo0SXMm-OHA0 May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:05:50.956516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-1482462012 May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 8ce65ea6e70145af9ef012219f753b53 May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1284528990", "metadata": {"Type": "work"}}} May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:05:50.959609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1284528990', 'metadata': {'Type': 'work'}}}} May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise error May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi '#$%' May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:05:50.960457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 17:05:50.963582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 17:05:50.965715 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 18 17:05:50.965715 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:50.965715 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-266e82ed-2253-443f-8fbc-6533eb2bb428 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:05:50.969937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-266e82ed-2253-443f-8fbc-6533eb2bb428 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 2.138298 May 18 17:05:50.975492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 1/1] 10.222.0.49 () {60 vars in 1155 bytes} [Wed May 18 17:05:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 17:05:51.001638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9f1feea6-0721-4d7d-9f4d-757b7be2dd07 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Action: 'create', calling method: .version_select at 0x7fef01b3a700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-570140897", "metadata": {"Type": "work"}}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9f1feea6-0721-4d7d-9f4d-757b7be2dd07 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Request method failure captured: May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 119 May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdsDCaMiWvkKePjRP7jqzxeGo4l7EACS7iR7RF3VVKwn5r2aSKbq2pqoJZEhQ7qChHNuqdm6JkTRTSoWJPpqD-70j9Lhbf6jLul8E-V92GGUAlu21gzDc5vRo7oAc8n_JjNqf-3kV8zni_zJhBcx9iDo9CD3bSLtR7mo0SXMm-OHA0 May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:05:51.005462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-1482462012 May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 8ce65ea6e70145af9ef012219f753b53 May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-570140897", "metadata": {"Type": "work"}}} May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:05:51.006890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-570140897', 'metadata': {'Type': 'work'}}}} May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise error May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi '0' May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:05:51.007723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 17:05:51.009057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 17:05:51.011601 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 18 17:05:51.011601 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.015287 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9f1feea6-0721-4d7d-9f4d-757b7be2dd07 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:05:51.016424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9f1feea6-0721-4d7d-9f4d-757b7be2dd07 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.039469 May 18 17:05:51.017284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 2/2] 10.222.0.49 () {60 vars in 1155 bytes} [Wed May 18 17:05:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 17:05:51.035571 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3c22b066-8fcd-4a5b-9b8c-b67e32241c4e tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Action: 'create', calling method: .version_select at 0x7fef01b0b5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-124575458", "metadata": {"Type": "work"}}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3c22b066-8fcd-4a5b-9b8c-b67e32241c4e tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Request method failure captured: May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 118 May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdsDCaMiWvkKePjRP7jqzxeGo4l7EACS7iR7RF3VVKwn5r2aSKbq2pqoJZEhQ7qChHNuqdm6JkTRTSoWJPpqD-70j9Lhbf6jLul8E-V92GGUAlu21gzDc5vRo7oAc8n_JjNqf-3kV8zni_zJhBcx9iDo9CD3bSLtR7mo0SXMm-OHA0 May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:05:51.038362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-1482462012 May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 8ce65ea6e70145af9ef012219f753b53 May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-124575458", "metadata": {"Type": "work"}}} May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:05:51.040051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-124575458', 'metadata': {'Type': 'work'}}}} May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise error May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi On instance['volume']: May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi '' May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:05:51.041015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 18 17:05:51.042862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 18 17:05:51.045331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 18 17:05:51.045331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:51.045331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3c22b066-8fcd-4a5b-9b8c-b67e32241c4e tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:05:51.046194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3c22b066-8fcd-4a5b-9b8c-b67e32241c4e tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013424 May 18 17:05:51.053021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 3/3] 10.222.0.49 () {60 vars in 1155 bytes} [Wed May 18 17:05:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 17:05:51.072535 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-31262444-36ef-4c3f-801c-645676d0c96a tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Calling method '.version_select at 0x7fef01a3a4c0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:51.538424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c4d5fe95-d7ef-4dab-be15-6f1626624909 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Action: 'create', calling method: .version_select at 0x7fef01b58550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2045276217", "metadata": {"Type": "work"}}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:05:51.974698 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-31262444-36ef-4c3f-801c-645676d0c96a tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] HTTP exception thrown: Volume tempest-invalid-2128006688 could not be found. May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-31262444-36ef-4c3f-801c-645676d0c96a tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Request method failure captured: May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2128006688 HTTP/1.1 May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdsDCaMiWvkKePjRP7jqzxeGo4l7EACS7iR7RF3VVKwn5r2aSKbq2pqoJZEhQ7qChHNuqdm6JkTRTSoWJPpqD-70j9Lhbf6jLul8E-V92GGUAlu21gzDc5vRo7oAc8n_JjNqf-3kV8zni_zJhBcx9iDo9CD3bSLtR7mo0SXMm-OHA0 May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:05:52.003347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 8ce65ea6e70145af9ef012219f753b53 May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Volume tempest-invalid-2128006688 could not be found. May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'tempest-invalid-2128006688'} May 18 17:05:52.004824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2128006688 could not be found. (HTTP 404) (Request-ID: req-f78b2677-431f-4b6f-96f0-6453c20d701f) May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.005618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 17:05:52.006909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2128006688 could not be found. May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:05:52.010462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2128006688 could not be found. May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2128006688 could not be found. May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.011761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-31262444-36ef-4c3f-801c-645676d0c96a tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Returning 404 to user: Volume tempest-invalid-2128006688 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:05:52.031482 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-31262444-36ef-4c3f-801c-645676d0c96a tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2128006688" status: 404 len: 99 microversion: 2.1 time: 0.976183 May 18 17:05:52.033483 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 4/4] 10.222.0.49 () {58 vars in 1217 bytes} [Wed May 18 17:05:51 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2128006688 => generated 99 bytes in 979 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 18 17:05:52.053396 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-aefcdcf8-5247-421e-b0a7-7c23beaaebf3 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012625 May 18 17:05:52.065616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 5/5] 10.222.0.49 () {58 vars in 1139 bytes} [Wed May 18 17:05:52 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 26 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 18 17:05:52.092717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7ca67753-f8b3-4085-a1f7-2061e677cc47 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.013479 May 18 17:05:52.094766 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 6/6] 10.222.0.49 () {58 vars in 1136 bytes} [Wed May 18 17:05:52 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 22 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 18 17:05:52.124363 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bbcebf94-4007-46f2-8d9f-6e25744e57b1 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Calling method '.version_select at 0x7fef019678b0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:52.707956 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-bbcebf94-4007-46f2-8d9f-6e25744e57b1 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] HTTP exception thrown: Volume a992a798-9640-49e7-9b37-fd8197cf89fc could not be found. May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bbcebf94-4007-46f2-8d9f-6e25744e57b1 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Request method failure captured: May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/os-volumes/a992a798-9640-49e7-9b37-fd8197cf89fc HTTP/1.1 May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdsDCaMiWvkKePjRP7jqzxeGo4l7EACS7iR7RF3VVKwn5r2aSKbq2pqoJZEhQ7qChHNuqdm6JkTRTSoWJPpqD-70j9Lhbf6jLul8E-V92GGUAlu21gzDc5vRo7oAc8n_JjNqf-3kV8zni_zJhBcx9iDo9CD3bSLtR7mo0SXMm-OHA0 May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:05:52.710797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 8ce65ea6e70145af9ef012219f753b53 May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Volume a992a798-9640-49e7-9b37-fd8197cf89fc could not be found. May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'a992a798-9640-49e7-9b37-fd8197cf89fc'} May 18 17:05:52.712234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a992a798-9640-49e7-9b37-fd8197cf89fc could not be found. (HTTP 404) (Request-ID: req-f794647d-0f38-42ee-a84f-bb9f657b33d1) May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.713343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 17:05:52.714444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a992a798-9640-49e7-9b37-fd8197cf89fc could not be found. May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 17:05:52.716223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a992a798-9640-49e7-9b37-fd8197cf89fc could not be found. May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a992a798-9640-49e7-9b37-fd8197cf89fc could not be found. May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bbcebf94-4007-46f2-8d9f-6e25744e57b1 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Returning 404 to user: Volume a992a798-9640-49e7-9b37-fd8197cf89fc could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bbcebf94-4007-46f2-8d9f-6e25744e57b1 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/a992a798-9640-49e7-9b37-fd8197cf89fc" status: 404 len: 109 microversion: 2.1 time: 0.610737 May 18 17:05:52.717433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 7/7] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:05:52 2022] DELETE /compute/v2.1/os-volumes/a992a798-9640-49e7-9b37-fd8197cf89fc => generated 109 bytes in 612 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:05:52.730440 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b1c67254-7a3b-4aa0-80da-9f4777e40a25 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Calling method '.version_select at 0x7fef01967310>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:52.862355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-b1c67254-7a3b-4aa0-80da-9f4777e40a25 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] HTTP exception thrown: Volume 0266d054-d78e-4fe9-95b4-9457f2901a27 could not be found. May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b1c67254-7a3b-4aa0-80da-9f4777e40a25 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Request method failure captured: May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/os-volumes/0266d054-d78e-4fe9-95b4-9457f2901a27 HTTP/1.1 May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdsDCaMiWvkKePjRP7jqzxeGo4l7EACS7iR7RF3VVKwn5r2aSKbq2pqoJZEhQ7qChHNuqdm6JkTRTSoWJPpqD-70j9Lhbf6jLul8E-V92GGUAlu21gzDc5vRo7oAc8n_JjNqf-3kV8zni_zJhBcx9iDo9CD3bSLtR7mo0SXMm-OHA0 May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:05:52.864759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0b3e1f13b2444681a0a32ac3810b7876"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0b3e1f13b2444681a0a32ac3810b7876 May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesNegativeTest-1482462012 May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 8ce65ea6e70145af9ef012219f753b53 May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesNegativeTest-1482462012-project May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Volume 0266d054-d78e-4fe9-95b4-9457f2901a27 could not be found. May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '0266d054-d78e-4fe9-95b4-9457f2901a27'} May 18 17:05:52.866400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0266d054-d78e-4fe9-95b4-9457f2901a27 could not be found. (HTTP 404) (Request-ID: req-c967e906-636a-4251-a299-cacb19549cf5) May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.867317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:05:52.868643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0266d054-d78e-4fe9-95b4-9457f2901a27 could not be found. May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 17:05:52.869980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0266d054-d78e-4fe9-95b4-9457f2901a27 could not be found. May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0266d054-d78e-4fe9-95b4-9457f2901a27 could not be found. May 18 17:05:52.871214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:52.873426 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b1c67254-7a3b-4aa0-80da-9f4777e40a25 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] Returning 404 to user: Volume 0266d054-d78e-4fe9-95b4-9457f2901a27 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:05:52.874691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b1c67254-7a3b-4aa0-80da-9f4777e40a25 tempest-VolumesNegativeTest-1482462012 tempest-VolumesNegativeTest-1482462012-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/0266d054-d78e-4fe9-95b4-9457f2901a27" status: 404 len: 109 microversion: 2.1 time: 0.155260 May 18 17:05:52.876135 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 8/8] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:52 2022] GET /compute/v2.1/os-volumes/0266d054-d78e-4fe9-95b4-9457f2901a27 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:05:53.012300 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c4d5fe95-d7ef-4dab-be15-6f1626624909 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.738118 May 18 17:05:53.012300 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 1/9] 10.222.0.49 () {60 vars in 1155 bytes} [Wed May 18 17:05:49 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3742 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 18 17:05:53.014888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-da547d5c-3726-42ec-9c2e-1eb1b4a1bdd1 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Calling method '.version_select at 0x7fef01967820>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:53.141906 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-da547d5c-3726-42ec-9c2e-1eb1b4a1bdd1 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7" status: 200 len: 353 microversion: 2.1 time: 0.151191 May 18 17:05:53.143704 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 9/10] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:52 2022] GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7 => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:05:54.080001 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d595a536-3938-4e03-a8aa-d59c710d3a04 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7fef01981310>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:54.243739 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d595a536-3938-4e03-a8aa-d59c710d3a04 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/ccda45f7-f16d-4691-bf12-07942a806575" status: 200 len: 351 microversion: 2.1 time: 0.167870 May 18 17:05:54.244431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 10/11] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:54 2022] GET /compute/v2.1/os-volumes/ccda45f7-f16d-4691-bf12-07942a806575 => generated 351 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:05:54.253694 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-664062778", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "networks": [{"uuid": "a063f326-5a66-4fe8-969a-97f27573228d"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:05:54.257264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e1f7e874-805e-4a3f-964c-f7e126ed0a47 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Calling method '.version_select at 0x7fef01981a60>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:54.533428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] validate_networks() for [('a063f326-5a66-4fe8-969a-97f27573228d', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:05:54.770311 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e1f7e874-805e-4a3f-964c-f7e126ed0a47 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7" status: 200 len: 354 microversion: 2.1 time: 0.524824 May 18 17:05:54.770868 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 11/12] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:54 2022] GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7 => generated 354 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:05:54.784150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-794fdf46-da3f-4ff6-8fa7-259489b7ee1d tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Calling method '.version_select at 0x7fef01906160>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:54.943196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-794fdf46-da3f-4ff6-8fa7-259489b7ee1d tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7" status: 200 len: 354 microversion: 2.1 time: 0.164864 May 18 17:05:54.943749 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 12/13] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:54 2022] GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7 => generated 354 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:05:54.960168 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-aadd6d67-2f33-49df-923c-60eb1f61add4 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Calling method '.version_select at 0x7fef01981820>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:55.098328 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-aadd6d67-2f33-49df-923c-60eb1f61add4 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7" status: 202 len: 0 microversion: 2.1 time: 0.141742 May 18 17:05:55.099603 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 13/14] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:05:54 2022] DELETE /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 17:05:55.109415 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8ac18e96-650c-403e-a922-e1fcde1a66ac tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Calling method '.version_select at 0x7fef01981040>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:55.241878 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8ac18e96-650c-403e-a922-e1fcde1a66ac tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7" status: 200 len: 353 microversion: 2.1 time: 0.137600 May 18 17:05:55.249207 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 14/15] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:55 2022] GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:05:56.255539 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-64974020-c161-4703-aea8-67b8d363979c tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Calling method '.version_select at 0x7fef01967310>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:56.357875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-64974020-c161-4703-aea8-67b8d363979c tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7" status: 200 len: 353 microversion: 2.1 time: 0.105959 May 18 17:05:56.358813 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 15/16] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:56 2022] GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7 => generated 353 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:05:57.049994 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:05:57.050573 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:05:57.050890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:05:57.051488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:05:57.052039 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:05:57.085051 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:05:57.085394 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:05:57.086393 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:05:57.086834 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:05:57.181356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Getting quotas for project 0f0e2176993f4c61bd976aa95fe55346. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:05:57.196796 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Getting quotas for user 69ca0baaf3854917bf6fc02883b0b949 and project 0f0e2176993f4c61bd976aa95fe55346. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:05:57.217317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:05:57.221579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:05:57.289234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-92798e08-6e6a-420f-b7db-af984063e852 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7fef01906670>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:57.353507 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-351be480-e0aa-409f-ac19-59716ba62474 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.568223 May 18 17:05:57.354845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 2/17] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:05:57.369608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ff00d0b-c777-4e5f-a637-2c52d68cc5a7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:57.370445 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6ff00d0b-c777-4e5f-a637-2c52d68cc5a7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:05:57.427619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-92798e08-6e6a-420f-b7db-af984063e852 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/d782c816-91ee-4d0a-8fd4-6983742e0795" status: 200 len: 350 microversion: 2.1 time: 0.147992 May 18 17:05:57.439813 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 16/18] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:57 2022] GET /compute/v2.1/os-volumes/d782c816-91ee-4d0a-8fd4-6983742e0795 => generated 350 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:05:57.452288 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-57ca529c-6eda-48be-8500-f81d754cfac6 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Calling method '.version_select at 0x7fef019675e0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:57.532163 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-57ca529c-6eda-48be-8500-f81d754cfac6 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] HTTP exception thrown: Volume f7835818-9574-49d3-b574-b1bbc1e278d7 could not be found. May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-57ca529c-6eda-48be-8500-f81d754cfac6 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Request method failure captured: May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7 HTTP/1.1 May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdtYQWKKoDxt8zMIX4VvnCS-ZFd7NFqxy1-ZPDiA-mSl2bYOafTWX58smkaOonaCF6-S5fyIyULT3O9ytkOPI5fHX24tlwFP2Bcw0o-Yc9pErBWkuXglEibBGp34YXkCQz29OclFHiPWp0e1pyPYKYLizYMihQeZH_4w93ttg-S5pQ May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 091b4f2f90bb45faaac46e59e35dd08b May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesGetTestJSON-2019273007 May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:05:57.537250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/091b4f2f90bb45faaac46e59e35dd08b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_091b4f2f90bb45faaac46e59e35dd08b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/091b4f2f90bb45faaac46e59e35dd08b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/091b4f2f90bb45faaac46e59e35dd08b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesGetTestJSON-2019273007 May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 091b4f2f90bb45faaac46e59e35dd08b May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesGetTestJSON-2019273007 May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesGetTestJSON-2019273007-project May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 59c033bb26aa457eae960dbd1aee7b81 May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesGetTestJSON-2019273007-project May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Volume f7835818-9574-49d3-b574-b1bbc1e278d7 could not be found. May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'f7835818-9574-49d3-b574-b1bbc1e278d7'} May 18 17:05:57.538423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7835818-9574-49d3-b574-b1bbc1e278d7 could not be found. (HTTP 404) (Request-ID: req-a92588d5-cb90-408a-9db6-f55d2a08c836) May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:57.539070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:05:57.539934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7835818-9574-49d3-b574-b1bbc1e278d7 could not be found. May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 17:05:57.540824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7835818-9574-49d3-b574-b1bbc1e278d7 could not be found. May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7835818-9574-49d3-b574-b1bbc1e278d7 could not be found. May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-57ca529c-6eda-48be-8500-f81d754cfac6 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] Returning 404 to user: Volume f7835818-9574-49d3-b574-b1bbc1e278d7 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-57ca529c-6eda-48be-8500-f81d754cfac6 tempest-VolumesGetTestJSON-2019273007 tempest-VolumesGetTestJSON-2019273007-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7" status: 404 len: 109 microversion: 2.1 time: 0.096647 May 18 17:05:57.546267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 17/19] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:05:57 2022] GET /compute/v2.1/os-volumes/f7835818-9574-49d3-b574-b1bbc1e278d7 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:05:57.721026 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6ff00d0b-c777-4e5f-a637-2c52d68cc5a7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:05:57.751959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6ff00d0b-c777-4e5f-a637-2c52d68cc5a7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1214 microversion: 2.1 time: 0.390592 May 18 17:05:57.752550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 3/20] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:05:57 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1214 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:05:58.781408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c0995898-e149-4537-9def-c0e5099bde50 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:05:58.783202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c0995898-e149-4537-9def-c0e5099bde50 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:05:59.009137 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c0995898-e149-4537-9def-c0e5099bde50 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:05:59.048132 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c0995898-e149-4537-9def-c0e5099bde50 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1214 microversion: 2.1 time: 0.271551 May 18 17:05:59.054608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 18/21] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:05:58 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1214 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:00.072518 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d246ea80-b6f8-467d-bd4c-7e533540c309 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:00.073317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d246ea80-b6f8-467d-bd4c-7e533540c309 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:00.087624 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d246ea80-b6f8-467d-bd4c-7e533540c309 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:00.089608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d246ea80-b6f8-467d-bd4c-7e533540c309 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:00.094700 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d246ea80-b6f8-467d-bd4c-7e533540c309 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:00.095495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d246ea80-b6f8-467d-bd4c-7e533540c309 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:00.706521 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d246ea80-b6f8-467d-bd4c-7e533540c309 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:00.734860 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d246ea80-b6f8-467d-bd4c-7e533540c309 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1218 microversion: 2.1 time: 0.667066 May 18 17:06:00.744323 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 4/22] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:00 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1218 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:01.759161 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e9a82222-dda0-41e5-a322-a3ff7eb43357 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:01.760609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e9a82222-dda0-41e5-a322-a3ff7eb43357 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:01.777159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9a82222-dda0-41e5-a322-a3ff7eb43357 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:01.778416 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9a82222-dda0-41e5-a322-a3ff7eb43357 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:01.779672 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9a82222-dda0-41e5-a322-a3ff7eb43357 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:01.780262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9a82222-dda0-41e5-a322-a3ff7eb43357 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:02.161698 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e9a82222-dda0-41e5-a322-a3ff7eb43357 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:02.190917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e9a82222-dda0-41e5-a322-a3ff7eb43357 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1218 microversion: 2.1 time: 0.426839 May 18 17:06:02.191789 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 19/23] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:01 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1218 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:02.619684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c1f977ed-a5f2-48e5-9c3c-0685092ad872 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: .version_select at 0x7fef008f5700>, body: {"keypair": {"name": "tempest-keypair-721053032", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC2NXQ4jLRdEkPCSilbUHd35fO5Cfk92qvg2CDEAXsDLQr4YzVP7svmrrU4XKNeazO7dn676KbICjOY3XzXxgQSotu8s27HsKkki06G0d2OkQxoySvMW9MN2IkYYRyerMQ=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:02.715606 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-c1f977ed-a5f2-48e5-9c3c-0685092ad872 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:06:02.722611 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-c1f977ed-a5f2-48e5-9c3c-0685092ad872 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for user 01881ccdf756480b8fcc1ac599fdf905 and project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:06:02.846769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c1f977ed-a5f2-48e5-9c3c-0685092ad872 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.806557 May 18 17:06:02.848049 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 5/24] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:06:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:06:03.209610 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-562d9d80-334d-4a9c-b04f-a9eaf703b01d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:03.211026 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-562d9d80-334d-4a9c-b04f-a9eaf703b01d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:03.218807 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-562d9d80-334d-4a9c-b04f-a9eaf703b01d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:03.219526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-562d9d80-334d-4a9c-b04f-a9eaf703b01d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:03.220509 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-562d9d80-334d-4a9c-b04f-a9eaf703b01d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:03.221314 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-562d9d80-334d-4a9c-b04f-a9eaf703b01d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:03.356964 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-562d9d80-334d-4a9c-b04f-a9eaf703b01d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:03.382714 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-562d9d80-334d-4a9c-b04f-a9eaf703b01d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1210 microversion: 2.1 time: 0.178130 May 18 17:06:03.398975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 20/25] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:03 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1210 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:04.406590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-59fc4afb-78c8-4572-b83c-cd96e54e75e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:04.407596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-59fc4afb-78c8-4572-b83c-cd96e54e75e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:04.416728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-59fc4afb-78c8-4572-b83c-cd96e54e75e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:04.427195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-59fc4afb-78c8-4572-b83c-cd96e54e75e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:04.428344 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-59fc4afb-78c8-4572-b83c-cd96e54e75e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:04.429200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-59fc4afb-78c8-4572-b83c-cd96e54e75e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:04.834626 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1809146030", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:04.960776 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] validate_networks() for [('f9c70e49-a6c9-4da7-a148-eecd9a6e2924', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:06:05.108104 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-59fc4afb-78c8-4572-b83c-cd96e54e75e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:05.116325 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-59fc4afb-78c8-4572-b83c-cd96e54e75e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1274 microversion: 2.1 time: 0.714008 May 18 17:06:05.129526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 21/26] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:04 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1274 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:05.134882 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0fc63cff-7e64-4501-aaa3-18618faa96d9 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7fef01868430>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:05.846806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0fc63cff-7e64-4501-aaa3-18618faa96d9 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/cf7347dd-7fc5-444c-8ba8-0a8cc2d0a642" status: 200 len: 350 microversion: 2.1 time: 0.715729 May 18 17:06:05.861241 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 22/27] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:06:05 2022] GET /compute/v2.1/os-volumes/cf7347dd-7fc5-444c-8ba8-0a8cc2d0a642 => generated 350 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:05.864439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1c57690f-0981-4f54-a4b5-19e366be1df7 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7fef01868160>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:06.205678 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1c57690f-0981-4f54-a4b5-19e366be1df7 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.344989 May 18 17:06:06.216210 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 23/28] 10.222.0.49 () {58 vars in 1133 bytes} [Wed May 18 17:06:05 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:06.216210 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84b95c3c-a267-43f4-9ec2-46a8d4d01a81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:06.216210 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84b95c3c-a267-43f4-9ec2-46a8d4d01a81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:06.243697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84b95c3c-a267-43f4-9ec2-46a8d4d01a81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:06.252341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84b95c3c-a267-43f4-9ec2-46a8d4d01a81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:06.255379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84b95c3c-a267-43f4-9ec2-46a8d4d01a81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:06.258232 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84b95c3c-a267-43f4-9ec2-46a8d4d01a81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:06.685715 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:06:06.686709 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:06:06.687437 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:06:06.687944 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:06:06.688377 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:06:06.778174 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:06.778963 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:06.785559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:06.794555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:06.947045 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Getting quotas for project af6df110a2604ba3adab104ec1decf4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:06:06.978935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Getting quotas for user 5e28c0ca22d143eebe6fc93f85442a7f and project af6df110a2604ba3adab104ec1decf4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:06:07.048928 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:06:07.063114 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:06:07.257209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2d99d633-4757-41f0-a232-03d302ab6e3d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.171047 May 18 17:06:07.259280 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 6/29] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:06:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 17:06:07.280242 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f6c546be-31df-45e4-a2ec-608d48b15efa tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7fef008099d0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:07.731844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f6c546be-31df-45e4-a2ec-608d48b15efa tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.471257 May 18 17:06:07.741193 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 7/30] 10.222.0.49 () {58 vars in 1148 bytes} [Wed May 18 17:06:07 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:07.972445 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84b95c3c-a267-43f4-9ec2-46a8d4d01a81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:08.008812 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84b95c3c-a267-43f4-9ec2-46a8d4d01a81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1272 microversion: 2.1 time: 1.800661 May 18 17:06:08.011434 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 24/31] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:06 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1272 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:08.024461 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a770d168-21c4-4fab-8eec-d63ab2aa09d3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:08.029764 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a770d168-21c4-4fab-8eec-d63ab2aa09d3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:08.544405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a2fa80d6-84e0-4468-8037-4952d104fdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'create', calling method: .version_select at 0x7fef008f5790>, body: {"keypair": {"name": "tempest-keypair-93537827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlvu7/1KECvLi1Mh0BS+QIgVY+5/0oq8UG+WEXKIxTUthNavFdgi20DOZVFCZ9/oEHMJhFLX1y7oprlBFfsPnrhART/8LE6RBZ3GLQmFupcVy8m5FXuR5NeSXAvErs0LQ=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:08.597297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a770d168-21c4-4fab-8eec-d63ab2aa09d3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:08.613011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-a2fa80d6-84e0-4468-8037-4952d104fdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Getting quotas for project 2ffb442f11714159af838b0176f885ca. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:06:08.646714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-a2fa80d6-84e0-4468-8037-4952d104fdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Getting quotas for user 9b596d7285294117b826f459a39872c1 and project 2ffb442f11714159af838b0176f885ca. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:06:08.662916 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a770d168-21c4-4fab-8eec-d63ab2aa09d3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1222 microversion: 2.1 time: 0.649886 May 18 17:06:08.665934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 25/32] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:08 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1222 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:08.679997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1c2ed381-dfee-437d-a57d-0fe56cddfc9d tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7fef01868ca0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:08.723644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a2fa80d6-84e0-4468-8037-4952d104fdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.980720 May 18 17:06:08.728780 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 8/33] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:06:07 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:09.033294 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-13200885-ff40-4f97-ab6a-6ba54a9a36f0 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:09.034898 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-13200885-ff40-4f97-ab6a-6ba54a9a36f0 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:09.055886 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-13200885-ff40-4f97-ab6a-6ba54a9a36f0 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:09.057111 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-13200885-ff40-4f97-ab6a-6ba54a9a36f0 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:09.060511 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-13200885-ff40-4f97-ab6a-6ba54a9a36f0 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:09.064892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-13200885-ff40-4f97-ab6a-6ba54a9a36f0 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:09.138291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1c2ed381-dfee-437d-a57d-0fe56cddfc9d tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.470995 May 18 17:06:09.139169 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 26/34] 10.222.0.49 () {58 vars in 1133 bytes} [Wed May 18 17:06:08 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:09.158711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1081111560", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:09.470809 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] validate_networks() for [('f9c70e49-a6c9-4da7-a148-eecd9a6e2924', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:06:09.699013 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-13200885-ff40-4f97-ab6a-6ba54a9a36f0 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:09.722008 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-13200885-ff40-4f97-ab6a-6ba54a9a36f0 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1272 microversion: 2.1 time: 0.682365 May 18 17:06:09.739315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 9/35] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:09 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1272 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:09.771216 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-077ba046-942e-4e9d-b641-38e5e3a527cf tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7feef3fd6e50>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:10.410694 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-077ba046-942e-4e9d-b641-38e5e3a527cf tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.669035 May 18 17:06:10.411821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 10/36] 10.222.0.49 () {58 vars in 1166 bytes} [Wed May 18 17:06:09 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:10.428719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-473967fa-e960-461b-a78b-215cb0f70b8f tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7feef3fe2790>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:10.838254 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-473967fa-e960-461b-a78b-215cb0f70b8f tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.416296 May 18 17:06:10.838837 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 11/37] 10.222.0.49 () {58 vars in 1169 bytes} [Wed May 18 17:06:10 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:06:10.843914 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-df6d5f54-dee2-4d16-b4d3-fb6515857437 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:10.844525 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-df6d5f54-dee2-4d16-b4d3-fb6515857437 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:10.867615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df6d5f54-dee2-4d16-b4d3-fb6515857437 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:10.868071 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df6d5f54-dee2-4d16-b4d3-fb6515857437 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:10.868854 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df6d5f54-dee2-4d16-b4d3-fb6515857437 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:10.869291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df6d5f54-dee2-4d16-b4d3-fb6515857437 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:12.130127 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-df6d5f54-dee2-4d16-b4d3-fb6515857437 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:12.156099 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-df6d5f54-dee2-4d16-b4d3-fb6515857437 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 1.307431 May 18 17:06:12.170170 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 12/38] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:10 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:12.175736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6406e5a5-84a8-4cce-a3d0-c2233852bb25 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7feef3fd6940>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:12.476515 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:06:12.477028 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:06:12.477553 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:06:12.478317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:06:12.478925 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:06:12.517291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:12.518141 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:12.519726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:12.520445 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:12.581871 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6406e5a5-84a8-4cce-a3d0-c2233852bb25 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.410195 May 18 17:06:12.592804 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 13/39] 10.222.0.49 () {58 vars in 1154 bytes} [Wed May 18 17:06:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:12.600829 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9ea21cd7-3555-49fb-89a0-b904ed16b515 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7feef3fe2d30>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:12.640872 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Getting quotas for project af6df110a2604ba3adab104ec1decf4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:06:12.687613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Getting quotas for user 5e28c0ca22d143eebe6fc93f85442a7f and project af6df110a2604ba3adab104ec1decf4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:06:12.757327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:06:12.760390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:06:12.891495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9ea21cd7-3555-49fb-89a0-b904ed16b515 tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.297074 May 18 17:06:12.903406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 14/40] 10.222.0.49 () {58 vars in 1187 bytes} [Wed May 18 17:06:12 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:12.917499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-66a9f7f8-3b0c-459c-84fc-347ed103316c tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] Calling method '.version_select at 0x7feef3fef430>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:12.987726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a6710d9f-26f3-464d-b09f-ce7c8f83f086 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.840139 May 18 17:06:12.993577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 27/41] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:06:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:06:12.999681 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-370a2831-a8e3-47cf-8843-066c6804dc91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:13.005225 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-370a2831-a8e3-47cf-8843-066c6804dc91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:13.311068 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-66a9f7f8-3b0c-459c-84fc-347ed103316c tempest-VolumesTestJSON-1138356042 tempest-VolumesTestJSON-1138356042-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.404725 May 18 17:06:13.311799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 15/42] 10.222.0.49 () {58 vars in 1154 bytes} [Wed May 18 17:06:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:13.344000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e653501b-1126-462c-8f4c-28bbc2e5d4f4 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:13.344890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e653501b-1126-462c-8f4c-28bbc2e5d4f4 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:13.393169 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e653501b-1126-462c-8f4c-28bbc2e5d4f4 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:13.396655 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e653501b-1126-462c-8f4c-28bbc2e5d4f4 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:13.397872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e653501b-1126-462c-8f4c-28bbc2e5d4f4 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:13.398533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e653501b-1126-462c-8f4c-28bbc2e5d4f4 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:14.806074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-370a2831-a8e3-47cf-8843-066c6804dc91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:14.831643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-370a2831-a8e3-47cf-8843-066c6804dc91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1222 microversion: 2.1 time: 1.836339 May 18 17:06:14.836269 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 28/43] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:12 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1222 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:15.640115 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2079962181", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1747880-dcf4-4125-af66-c635d137ec57"}], "security_groups": [{"name": "tempest-securitygroup--1466404488"}], "key_name": "tempest-keypair-721053032", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:16.780418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] validate_networks() for [('f1747880-dcf4-4125-af66-c635d137ec57', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:06:16.812653 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e653501b-1126-462c-8f4c-28bbc2e5d4f4 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:16.831275 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e653501b-1126-462c-8f4c-28bbc2e5d4f4 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 3.502263 May 18 17:06:16.843044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 16/44] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:13 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 3531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:16.863798 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-daa57a12-f117-43e5-b21c-739b61388745 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:16.866683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-daa57a12-f117-43e5-b21c-739b61388745 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:16.890139 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-daa57a12-f117-43e5-b21c-739b61388745 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:16.898974 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-daa57a12-f117-43e5-b21c-739b61388745 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:16.903716 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-daa57a12-f117-43e5-b21c-739b61388745 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:16.903716 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-daa57a12-f117-43e5-b21c-739b61388745 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:16.903716 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=4 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:17.273817 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-daa57a12-f117-43e5-b21c-739b61388745 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:17.290392 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-daa57a12-f117-43e5-b21c-739b61388745 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1280 microversion: 2.1 time: 0.444778 May 18 17:06:17.305762 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 17/45] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:16 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1280 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:17.502867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-f7c7d2c4-3f52-4993-81ec-d882d74e1fbb req-810cec7d-c112-40bc-a8ef-e5f03b62b710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9803931-931f-4c10-92de-264b813d7d3c", "tag": "9288fe21-bb66-4add-9ae5-bc39c25cdcb7"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:17.529042 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f7c7d2c4-3f52-4993-81ec-d882d74e1fbb req-810cec7d-c112-40bc-a8ef-e5f03b62b710 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:17.529296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f7c7d2c4-3f52-4993-81ec-d882d74e1fbb req-810cec7d-c112-40bc-a8ef-e5f03b62b710 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:17.581314 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-f7c7d2c4-3f52-4993-81ec-d882d74e1fbb req-810cec7d-c112-40bc-a8ef-e5f03b62b710 service nova] Creating event network-changed:9288fe21-bb66-4add-9ae5-bc39c25cdcb7 for instance e9803931-931f-4c10-92de-264b813d7d3c on hv-cinder-79578 May 18 17:06:17.594130 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f7c7d2c4-3f52-4993-81ec-d882d74e1fbb req-810cec7d-c112-40bc-a8ef-e5f03b62b710 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 18 17:06:17.595706 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35ca15da-4393-42ba-94a8-e4d729597935 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:17.596241 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35ca15da-4393-42ba-94a8-e4d729597935 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:17.596959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35ca15da-4393-42ba-94a8-e4d729597935 None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:17.597403 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35ca15da-4393-42ba-94a8-e4d729597935 None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:17.616182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.compute.rpcapi [None req-35ca15da-4393-42ba-94a8-e4d729597935 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 18 17:06:17.616998 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35ca15da-4393-42ba-94a8-e4d729597935 None None] Releasing lock "compute-rpcapi-router" {{(pid=117731) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 18 17:06:17.669588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-35ca15da-4393-42ba-94a8-e4d729597935 None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361085 May 18 17:06:17.671161 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 18/46] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:17.863161 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b142466c-c641-406e-8434-d8bf61c8fd70 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:17.864823 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b142466c-c641-406e-8434-d8bf61c8fd70 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:17.899543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b142466c-c641-406e-8434-d8bf61c8fd70 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:17.906189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b142466c-c641-406e-8434-d8bf61c8fd70 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:17.908608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b142466c-c641-406e-8434-d8bf61c8fd70 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:17.926919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b142466c-c641-406e-8434-d8bf61c8fd70 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:18.469743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b142466c-c641-406e-8434-d8bf61c8fd70 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:18.482540 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b142466c-c641-406e-8434-d8bf61c8fd70 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.624610 May 18 17:06:18.483011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 19/47] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:17 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:18.505244 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b8f07d18-ce85-42a9-85c3-baada72e5ecc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:18.505909 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b8f07d18-ce85-42a9-85c3-baada72e5ecc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:18.526466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8f07d18-ce85-42a9-85c3-baada72e5ecc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:18.528049 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8f07d18-ce85-42a9-85c3-baada72e5ecc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:18.529283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8f07d18-ce85-42a9-85c3-baada72e5ecc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:18.530979 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b8f07d18-ce85-42a9-85c3-baada72e5ecc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:18.666110 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=22 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:18.985486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b8f07d18-ce85-42a9-85c3-baada72e5ecc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:19.007298 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b8f07d18-ce85-42a9-85c3-baada72e5ecc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1280 microversion: 2.1 time: 0.517517 May 18 17:06:19.008506 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 20/48] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:18 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1280 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:19.019454 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1352022070", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ff4b25c-cd6f-470d-aceb-0e6e57ec0656"}], "security_groups": [{"name": "tempest-securitygroup--1076945382"}], "key_name": "tempest-keypair-93537827", "user_data": "}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:19.507567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] validate_networks() for [('4ff4b25c-cd6f-470d-aceb-0e6e57ec0656', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:06:20.044328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:20.378575 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:06:20.380686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:06:20.382327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:06:20.391327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:06:20.392878 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:06:20.405972 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:20.426825 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:20.427532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:20.429052 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:20.432349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:20.477610 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:06:20.493446 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for user 01881ccdf756480b8fcc1ac599fdf905 and project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:06:20.525186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:06:20.528464 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:06:20.584169 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:06:20.584789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:06:20.585492 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:06:20.586145 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:06:20.587117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:06:20.608744 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:20.609210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:20.610142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:20.610633 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:20.620850 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=51 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:20.665921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Getting quotas for project 2ffb442f11714159af838b0176f885ca. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:06:20.671075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Getting quotas for user 9b596d7285294117b826f459a39872c1 and project 2ffb442f11714159af838b0176f885ca. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:06:20.724195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1bf5aefe-71e1-412c-9056-2e1a308821c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.089363 May 18 17:06:20.726038 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:06:20.736791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:06:20.738174 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 29/49] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:06:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 5105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:06:20.756461 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c0c94284-d208-4bd7-b9cb-28766930be7e tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:20.766987 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c0c94284-d208-4bd7-b9cb-28766930be7e tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:20.822609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0c94284-d208-4bd7-b9cb-28766930be7e tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:20.823072 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0c94284-d208-4bd7-b9cb-28766930be7e tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:20.829808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0c94284-d208-4bd7-b9cb-28766930be7e tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:20.830284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c0c94284-d208-4bd7-b9cb-28766930be7e tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:21.005641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7c588c93-0350-4e2e-8d32-c7cce24b9012 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.995800 May 18 17:06:21.022538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 21/50] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:06:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 2013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:06:21.033239 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d408e4f1-d284-483a-b635-e780aba49a5d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:21.056597 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d408e4f1-d284-483a-b635-e780aba49a5d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:21.104946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d408e4f1-d284-483a-b635-e780aba49a5d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:21.105544 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d408e4f1-d284-483a-b635-e780aba49a5d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:21.107077 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d408e4f1-d284-483a-b635-e780aba49a5d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:21.107737 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d408e4f1-d284-483a-b635-e780aba49a5d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:21.274769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d408e4f1-d284-483a-b635-e780aba49a5d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:21.292273 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d408e4f1-d284-483a-b635-e780aba49a5d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1280 microversion: 2.1 time: 0.266048 May 18 17:06:21.306543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 22/51] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:21 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1280 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:21.331335 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4893b29a-f640-48bb-8b93-099c0f6cfa2c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:21.332302 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4893b29a-f640-48bb-8b93-099c0f6cfa2c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:21.501181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4893b29a-f640-48bb-8b93-099c0f6cfa2c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:21.515235 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4893b29a-f640-48bb-8b93-099c0f6cfa2c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1241 microversion: 2.1 time: 0.202526 May 18 17:06:21.518033 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 23/52] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:21 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1241 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:21.523472 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9ff99dc0-2b4a-40c7-b969-8ba9c0d0cc11 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:21.532281 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9ff99dc0-2b4a-40c7-b969-8ba9c0d0cc11 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:22.264327 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9ff99dc0-2b4a-40c7-b969-8ba9c0d0cc11 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:22.274853 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9ff99dc0-2b4a-40c7-b969-8ba9c0d0cc11 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1236 microversion: 2.1 time: 0.755400 May 18 17:06:22.275134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c0c94284-d208-4bd7-b9cb-28766930be7e tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:22.289731 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 24/53] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:21 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1236 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:22.322651 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-05ee85be-1313-4065-bd79-a19c566d562e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:22.327228 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-05ee85be-1313-4065-bd79-a19c566d562e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:22.328750 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c0c94284-d208-4bd7-b9cb-28766930be7e tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 1.587799 May 18 17:06:22.330487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 30/54] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:20 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:22.346802 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05ee85be-1313-4065-bd79-a19c566d562e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:22.348464 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05ee85be-1313-4065-bd79-a19c566d562e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:22.350811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05ee85be-1313-4065-bd79-a19c566d562e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:22.352652 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05ee85be-1313-4065-bd79-a19c566d562e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:22.534627 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-47922f08-6b02-4938-80ab-419aa72d88e4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:22.535606 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-47922f08-6b02-4938-80ab-419aa72d88e4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:22.574748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-47922f08-6b02-4938-80ab-419aa72d88e4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:22.578164 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-47922f08-6b02-4938-80ab-419aa72d88e4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:22.588975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-47922f08-6b02-4938-80ab-419aa72d88e4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:22.596460 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-47922f08-6b02-4938-80ab-419aa72d88e4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:23.081915 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-47922f08-6b02-4938-80ab-419aa72d88e4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:23.092623 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-47922f08-6b02-4938-80ab-419aa72d88e4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1245 microversion: 2.1 time: 0.563077 May 18 17:06:23.113837 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 31/55] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:22 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1245 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:23.144496 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-05ee85be-1313-4065-bd79-a19c566d562e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:23.193617 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-05ee85be-1313-4065-bd79-a19c566d562e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.881193 May 18 17:06:23.194640 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 25/56] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:22 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:23.301761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8b9c37e2-f3cf-4010-b5f1-ee159ff22356 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:23.307240 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8b9c37e2-f3cf-4010-b5f1-ee159ff22356 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:23.331054 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b9c37e2-f3cf-4010-b5f1-ee159ff22356 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:23.331784 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b9c37e2-f3cf-4010-b5f1-ee159ff22356 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:23.333005 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b9c37e2-f3cf-4010-b5f1-ee159ff22356 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:23.333857 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b9c37e2-f3cf-4010-b5f1-ee159ff22356 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:23.348769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-748870d1-fbb6-4e96-9739-23909ea62c5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:23.349650 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-748870d1-fbb6-4e96-9739-23909ea62c5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:23.360513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-748870d1-fbb6-4e96-9739-23909ea62c5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:23.365593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-748870d1-fbb6-4e96-9739-23909ea62c5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:23.367046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-748870d1-fbb6-4e96-9739-23909ea62c5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:23.370065 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-748870d1-fbb6-4e96-9739-23909ea62c5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:23.541473 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8b9c37e2-f3cf-4010-b5f1-ee159ff22356 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:23.556107 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8b9c37e2-f3cf-4010-b5f1-ee159ff22356 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1232 microversion: 2.1 time: 0.259866 May 18 17:06:23.562809 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 32/57] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:23 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1232 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:23.789477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-748870d1-fbb6-4e96-9739-23909ea62c5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:23.798729 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-748870d1-fbb6-4e96-9739-23909ea62c5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.453341 May 18 17:06:23.807924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 26/58] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:23 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:24.121717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6fed046a-d519-47fe-a130-f31c95960c22 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:24.125494 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6fed046a-d519-47fe-a130-f31c95960c22 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:24.150525 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fed046a-d519-47fe-a130-f31c95960c22 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.151283 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fed046a-d519-47fe-a130-f31c95960c22 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.154725 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fed046a-d519-47fe-a130-f31c95960c22 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.156636 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fed046a-d519-47fe-a130-f31c95960c22 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.309192 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6fed046a-d519-47fe-a130-f31c95960c22 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:24.322040 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6fed046a-d519-47fe-a130-f31c95960c22 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1293 microversion: 2.1 time: 0.211286 May 18 17:06:24.323255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 33/59] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:24 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1293 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:24.369137 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d877701c-06a5-4e6d-978b-4a8e6f98fc93 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:24.374097 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d877701c-06a5-4e6d-978b-4a8e6f98fc93 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:24.391745 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d877701c-06a5-4e6d-978b-4a8e6f98fc93 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.392489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d877701c-06a5-4e6d-978b-4a8e6f98fc93 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.414159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d877701c-06a5-4e6d-978b-4a8e6f98fc93 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.415084 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d877701c-06a5-4e6d-978b-4a8e6f98fc93 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.615257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-252d0b94-45ed-4517-96ba-8ccca411afc2 req-8d51b70b-d61a-49ea-837d-b87d9f0f5aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a1e5ac3-2af5-4bee-a830-1f6014618699", "tag": "48153f9f-0291-4a2d-98eb-9f34883f13df"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:24.642253 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-252d0b94-45ed-4517-96ba-8ccca411afc2 req-8d51b70b-d61a-49ea-837d-b87d9f0f5aa6 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.648329 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-252d0b94-45ed-4517-96ba-8ccca411afc2 req-8d51b70b-d61a-49ea-837d-b87d9f0f5aa6 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.676462 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-252d0b94-45ed-4517-96ba-8ccca411afc2 req-8d51b70b-d61a-49ea-837d-b87d9f0f5aa6 service nova] Creating event network-changed:48153f9f-0291-4a2d-98eb-9f34883f13df for instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 on hv-cinder-79578 May 18 17:06:24.687752 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-252d0b94-45ed-4517-96ba-8ccca411afc2 req-8d51b70b-d61a-49ea-837d-b87d9f0f5aa6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.539249 May 18 17:06:24.689300 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 27/60] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:24.706258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-4a02665e-ea8a-4403-935d-4d29010429de req-0d6b310e-3219-46c4-bb1d-94fd3a529bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f5c3626-81f9-412a-9759-82527b75e30e", "tag": "8a8ee3d0-ac7c-4e62-9f8b-23af1601e83f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:24.728083 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-4a02665e-ea8a-4403-935d-4d29010429de req-0d6b310e-3219-46c4-bb1d-94fd3a529bd1 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.728663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-4a02665e-ea8a-4403-935d-4d29010429de req-0d6b310e-3219-46c4-bb1d-94fd3a529bd1 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.744395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-4a02665e-ea8a-4403-935d-4d29010429de req-0d6b310e-3219-46c4-bb1d-94fd3a529bd1 service nova] Creating event network-changed:8a8ee3d0-ac7c-4e62-9f8b-23af1601e83f for instance 7f5c3626-81f9-412a-9759-82527b75e30e on hv-cinder-79578 May 18 17:06:24.752398 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-4a02665e-ea8a-4403-935d-4d29010429de req-0d6b310e-3219-46c4-bb1d-94fd3a529bd1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058177 May 18 17:06:24.753250 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 28/61] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:24.761193 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3e9066d3-3894-4b06-a7df-c338a61fc5b2 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:24.763565 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3e9066d3-3894-4b06-a7df-c338a61fc5b2 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:24.774351 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e9066d3-3894-4b06-a7df-c338a61fc5b2 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.775809 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e9066d3-3894-4b06-a7df-c338a61fc5b2 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.777964 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e9066d3-3894-4b06-a7df-c338a61fc5b2 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.778737 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e9066d3-3894-4b06-a7df-c338a61fc5b2 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.848728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d877701c-06a5-4e6d-978b-4a8e6f98fc93 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:24.866658 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d877701c-06a5-4e6d-978b-4a8e6f98fc93 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.539234 May 18 17:06:24.869334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 34/62] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:24 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:24.895745 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d484ae6d-36b9-419d-ac15-a9bcd409f76c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:24.896575 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d484ae6d-36b9-419d-ac15-a9bcd409f76c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:24.931069 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d484ae6d-36b9-419d-ac15-a9bcd409f76c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.935134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d484ae6d-36b9-419d-ac15-a9bcd409f76c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.939420 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d484ae6d-36b9-419d-ac15-a9bcd409f76c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:24.942148 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d484ae6d-36b9-419d-ac15-a9bcd409f76c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:24.953245 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3e9066d3-3894-4b06-a7df-c338a61fc5b2 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:24.972789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3e9066d3-3894-4b06-a7df-c338a61fc5b2 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1232 microversion: 2.1 time: 0.217970 May 18 17:06:24.974994 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 29/63] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:24 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1232 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:25.354281 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4995135a-20e3-48f5-a725-a8cd6d63aa04 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:25.354982 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4995135a-20e3-48f5-a725-a8cd6d63aa04 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:25.377144 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4995135a-20e3-48f5-a725-a8cd6d63aa04 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:25.377975 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4995135a-20e3-48f5-a725-a8cd6d63aa04 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:25.379707 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4995135a-20e3-48f5-a725-a8cd6d63aa04 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:25.385549 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4995135a-20e3-48f5-a725-a8cd6d63aa04 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:25.525155 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d484ae6d-36b9-419d-ac15-a9bcd409f76c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:25.527819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4995135a-20e3-48f5-a725-a8cd6d63aa04 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:25.535976 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d484ae6d-36b9-419d-ac15-a9bcd409f76c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.654414 May 18 17:06:25.546604 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 35/64] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:24 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:25.550437 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4995135a-20e3-48f5-a725-a8cd6d63aa04 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1293 microversion: 2.1 time: 0.200741 May 18 17:06:25.551540 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 30/65] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:25 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1293 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:25.895932 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3285b21-ceae-413e-8801-1731d66eeefd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:25.900613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d3285b21-ceae-413e-8801-1731d66eeefd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:25.935215 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3285b21-ceae-413e-8801-1731d66eeefd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:25.935215 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3285b21-ceae-413e-8801-1731d66eeefd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:25.935531 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3285b21-ceae-413e-8801-1731d66eeefd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:25.936123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3285b21-ceae-413e-8801-1731d66eeefd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:25.998173 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8babd45c-d22c-4a74-a660-80958fc0c72e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:25.998799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8babd45c-d22c-4a74-a660-80958fc0c72e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:26.006525 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8babd45c-d22c-4a74-a660-80958fc0c72e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:26.015223 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8babd45c-d22c-4a74-a660-80958fc0c72e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:26.016236 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8babd45c-d22c-4a74-a660-80958fc0c72e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:26.016697 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8babd45c-d22c-4a74-a660-80958fc0c72e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:26.291440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8babd45c-d22c-4a74-a660-80958fc0c72e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:26.302070 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8babd45c-d22c-4a74-a660-80958fc0c72e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.309336 May 18 17:06:26.302672 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 31/66] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:25 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:26.555096 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5a845030-c707-4722-a212-33d974e51a3d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:26.555732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5a845030-c707-4722-a212-33d974e51a3d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:26.565236 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5a845030-c707-4722-a212-33d974e51a3d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:26.567661 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5a845030-c707-4722-a212-33d974e51a3d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:26.568697 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5a845030-c707-4722-a212-33d974e51a3d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:26.569156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5a845030-c707-4722-a212-33d974e51a3d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:26.679390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d3285b21-ceae-413e-8801-1731d66eeefd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:26.692347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d3285b21-ceae-413e-8801-1731d66eeefd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.808338 May 18 17:06:26.693372 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 36/67] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:25 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:26.711765 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ca51b20f-aa6c-4016-913d-199127110fd8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:26.714399 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ca51b20f-aa6c-4016-913d-199127110fd8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:26.731690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca51b20f-aa6c-4016-913d-199127110fd8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:26.732361 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca51b20f-aa6c-4016-913d-199127110fd8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:26.733368 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca51b20f-aa6c-4016-913d-199127110fd8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:26.734273 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ca51b20f-aa6c-4016-913d-199127110fd8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:26.818686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ca51b20f-aa6c-4016-913d-199127110fd8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:26.828532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ca51b20f-aa6c-4016-913d-199127110fd8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.133919 May 18 17:06:26.835152 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 37/68] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:26 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:26.848736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5a845030-c707-4722-a212-33d974e51a3d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:26.863941 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5a845030-c707-4722-a212-33d974e51a3d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.313036 May 18 17:06:26.865054 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 32/69] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:26 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:27.320253 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4fd3af0b-2c9c-4fba-9ba4-746a70f0d824 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:27.321232 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4fd3af0b-2c9c-4fba-9ba4-746a70f0d824 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:27.327924 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fd3af0b-2c9c-4fba-9ba4-746a70f0d824 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:27.328492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fd3af0b-2c9c-4fba-9ba4-746a70f0d824 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:27.329471 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fd3af0b-2c9c-4fba-9ba4-746a70f0d824 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:27.330100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fd3af0b-2c9c-4fba-9ba4-746a70f0d824 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:27.396910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4fd3af0b-2c9c-4fba-9ba4-746a70f0d824 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:27.405976 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4fd3af0b-2c9c-4fba-9ba4-746a70f0d824 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.089446 May 18 17:06:27.406572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 38/70] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:27 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:27.710555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5653cfdf-d2b4-407f-ac05-10d3f0c8ec46 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:27.711173 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5653cfdf-d2b4-407f-ac05-10d3f0c8ec46 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:27.718369 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5653cfdf-d2b4-407f-ac05-10d3f0c8ec46 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:27.718831 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5653cfdf-d2b4-407f-ac05-10d3f0c8ec46 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:27.719698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5653cfdf-d2b4-407f-ac05-10d3f0c8ec46 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:27.720140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5653cfdf-d2b4-407f-ac05-10d3f0c8ec46 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:27.846929 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8c570efa-9f7b-459a-95be-7805acea1e5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:27.847547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8c570efa-9f7b-459a-95be-7805acea1e5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:27.853969 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c570efa-9f7b-459a-95be-7805acea1e5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:27.854393 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c570efa-9f7b-459a-95be-7805acea1e5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:27.855158 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c570efa-9f7b-459a-95be-7805acea1e5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:27.856102 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c570efa-9f7b-459a-95be-7805acea1e5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:27.870768 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5653cfdf-d2b4-407f-ac05-10d3f0c8ec46 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:27.880520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5653cfdf-d2b4-407f-ac05-10d3f0c8ec46 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.173715 May 18 17:06:27.881105 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 33/71] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:27 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:27.888413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-54a0d874-006f-497d-b016-2245abbce65f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:27.889230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-54a0d874-006f-497d-b016-2245abbce65f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:27.895456 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54a0d874-006f-497d-b016-2245abbce65f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:27.895900 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54a0d874-006f-497d-b016-2245abbce65f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:27.896665 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54a0d874-006f-497d-b016-2245abbce65f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:27.897091 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54a0d874-006f-497d-b016-2245abbce65f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:27.930197 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8c570efa-9f7b-459a-95be-7805acea1e5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:27.940959 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8c570efa-9f7b-459a-95be-7805acea1e5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.096191 May 18 17:06:27.941920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 39/72] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:27 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:28.056708 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-54a0d874-006f-497d-b016-2245abbce65f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:28.066683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-54a0d874-006f-497d-b016-2245abbce65f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.183904 May 18 17:06:28.067532 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 34/73] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:27 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:28.422920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7ec090cf-8e3e-4a32-9683-8f22dbd74951 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:28.423534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7ec090cf-8e3e-4a32-9683-8f22dbd74951 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:28.429937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ec090cf-8e3e-4a32-9683-8f22dbd74951 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:28.430462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ec090cf-8e3e-4a32-9683-8f22dbd74951 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:28.431258 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ec090cf-8e3e-4a32-9683-8f22dbd74951 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:28.431691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7ec090cf-8e3e-4a32-9683-8f22dbd74951 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:28.498207 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7ec090cf-8e3e-4a32-9683-8f22dbd74951 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:28.506543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7ec090cf-8e3e-4a32-9683-8f22dbd74951 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.087409 May 18 17:06:28.507126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 40/74] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:28 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:28.903177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-496d5f09-0661-46db-bea5-549c9f0e514e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:28.905249 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-496d5f09-0661-46db-bea5-549c9f0e514e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:28.912507 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-496d5f09-0661-46db-bea5-549c9f0e514e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:28.912968 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-496d5f09-0661-46db-bea5-549c9f0e514e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:28.914007 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-496d5f09-0661-46db-bea5-549c9f0e514e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:28.914669 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-496d5f09-0661-46db-bea5-549c9f0e514e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:28.958525 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3c021f50-56c9-4c64-b161-e43b8c1d0294 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:28.959704 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3c021f50-56c9-4c64-b161-e43b8c1d0294 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:28.968467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3c021f50-56c9-4c64-b161-e43b8c1d0294 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:28.969102 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3c021f50-56c9-4c64-b161-e43b8c1d0294 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:28.970597 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3c021f50-56c9-4c64-b161-e43b8c1d0294 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:28.971195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3c021f50-56c9-4c64-b161-e43b8c1d0294 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:28.977453 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=95 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:29.135141 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3c021f50-56c9-4c64-b161-e43b8c1d0294 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:29.145500 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3c021f50-56c9-4c64-b161-e43b8c1d0294 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.190405 May 18 17:06:29.146237 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 41/75] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:28 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:29.151439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-62750a62-d3ca-4eef-9d7b-f14e24cd934d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:29.152175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-62750a62-d3ca-4eef-9d7b-f14e24cd934d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:29.152987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-496d5f09-0661-46db-bea5-549c9f0e514e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:29.162283 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62750a62-d3ca-4eef-9d7b-f14e24cd934d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:29.163808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62750a62-d3ca-4eef-9d7b-f14e24cd934d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:29.165393 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62750a62-d3ca-4eef-9d7b-f14e24cd934d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:29.165860 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-496d5f09-0661-46db-bea5-549c9f0e514e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.270931 May 18 17:06:29.166696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62750a62-d3ca-4eef-9d7b-f14e24cd934d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:29.166863 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 35/76] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:28 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:29.318775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-62750a62-d3ca-4eef-9d7b-f14e24cd934d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:29.328368 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-62750a62-d3ca-4eef-9d7b-f14e24cd934d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.180986 May 18 17:06:29.328953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 42/77] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:29 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:29.523874 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1883cd77-02c3-4722-a0d5-0372d4e65ff8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:29.524436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1883cd77-02c3-4722-a0d5-0372d4e65ff8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:29.530902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1883cd77-02c3-4722-a0d5-0372d4e65ff8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:29.531351 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1883cd77-02c3-4722-a0d5-0372d4e65ff8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:29.532125 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1883cd77-02c3-4722-a0d5-0372d4e65ff8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:29.532585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1883cd77-02c3-4722-a0d5-0372d4e65ff8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:29.597331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1883cd77-02c3-4722-a0d5-0372d4e65ff8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:29.605283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1883cd77-02c3-4722-a0d5-0372d4e65ff8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.085249 May 18 17:06:29.607200 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 36/78] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:29 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:30.165349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-94d1ec8d-7a0b-42b5-85b7-5bcb0b25b8b8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:30.166510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-94d1ec8d-7a0b-42b5-85b7-5bcb0b25b8b8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:30.175630 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-94d1ec8d-7a0b-42b5-85b7-5bcb0b25b8b8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:30.177716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-94d1ec8d-7a0b-42b5-85b7-5bcb0b25b8b8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:30.177716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-94d1ec8d-7a0b-42b5-85b7-5bcb0b25b8b8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:30.177716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-94d1ec8d-7a0b-42b5-85b7-5bcb0b25b8b8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:30.184322 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4ab9a69b-cd6d-4ce0-a6d0-a9e4dc040031 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:30.184896 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4ab9a69b-cd6d-4ce0-a6d0-a9e4dc040031 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:30.202274 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4ab9a69b-cd6d-4ce0-a6d0-a9e4dc040031 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:30.202931 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4ab9a69b-cd6d-4ce0-a6d0-a9e4dc040031 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:30.203947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4ab9a69b-cd6d-4ce0-a6d0-a9e4dc040031 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:30.204480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4ab9a69b-cd6d-4ce0-a6d0-a9e4dc040031 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:30.262548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-94d1ec8d-7a0b-42b5-85b7-5bcb0b25b8b8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:30.279590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-94d1ec8d-7a0b-42b5-85b7-5bcb0b25b8b8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.119838 May 18 17:06:30.280664 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 43/79] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:30 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:30.346919 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7007feb7-f1cb-4d0b-9d6b-700b95adb3f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:30.347848 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7007feb7-f1cb-4d0b-9d6b-700b95adb3f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:30.355009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7007feb7-f1cb-4d0b-9d6b-700b95adb3f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:30.356195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7007feb7-f1cb-4d0b-9d6b-700b95adb3f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:30.356996 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7007feb7-f1cb-4d0b-9d6b-700b95adb3f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:30.357790 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7007feb7-f1cb-4d0b-9d6b-700b95adb3f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:30.413033 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4ab9a69b-cd6d-4ce0-a6d0-a9e4dc040031 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:30.426292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4ab9a69b-cd6d-4ce0-a6d0-a9e4dc040031 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.246814 May 18 17:06:30.429960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 37/80] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:30 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:30.458655 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:30.510289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=18 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:30.526775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7007feb7-f1cb-4d0b-9d6b-700b95adb3f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:30.538625 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7007feb7-f1cb-4d0b-9d6b-700b95adb3f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.196049 May 18 17:06:30.539318 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 44/81] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:30 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:30.627445 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3e847f3c-124a-422b-af89-d8c66605f930 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:30.628174 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3e847f3c-124a-422b-af89-d8c66605f930 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:30.630280 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=4 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:30.636012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e847f3c-124a-422b-af89-d8c66605f930 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:30.637117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e847f3c-124a-422b-af89-d8c66605f930 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:30.638000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e847f3c-124a-422b-af89-d8c66605f930 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:30.638495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3e847f3c-124a-422b-af89-d8c66605f930 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:30.707643 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3e847f3c-124a-422b-af89-d8c66605f930 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:30.716638 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3e847f3c-124a-422b-af89-d8c66605f930 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.096424 May 18 17:06:30.717233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 38/82] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:30 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:31.299396 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0a5c53f3-24f8-4123-8bbb-5ace4fef578e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:31.301382 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0a5c53f3-24f8-4123-8bbb-5ace4fef578e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:31.311406 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a5c53f3-24f8-4123-8bbb-5ace4fef578e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:31.312143 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a5c53f3-24f8-4123-8bbb-5ace4fef578e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:31.313302 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a5c53f3-24f8-4123-8bbb-5ace4fef578e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:31.313982 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a5c53f3-24f8-4123-8bbb-5ace4fef578e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:31.395228 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0a5c53f3-24f8-4123-8bbb-5ace4fef578e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:31.407031 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0a5c53f3-24f8-4123-8bbb-5ace4fef578e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.111118 May 18 17:06:31.408002 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 45/83] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:31 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:31.444712 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0ccad6b0-daf4-46bc-a630-3616cb5aee8c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:31.445337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0ccad6b0-daf4-46bc-a630-3616cb5aee8c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:31.452585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ccad6b0-daf4-46bc-a630-3616cb5aee8c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:31.453292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ccad6b0-daf4-46bc-a630-3616cb5aee8c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:31.454251 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ccad6b0-daf4-46bc-a630-3616cb5aee8c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:31.454851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ccad6b0-daf4-46bc-a630-3616cb5aee8c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:31.560077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-04ef47b1-3aa1-4824-a0ce-d224a1ca619f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:31.561084 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-04ef47b1-3aa1-4824-a0ce-d224a1ca619f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:31.568114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-04ef47b1-3aa1-4824-a0ce-d224a1ca619f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:31.569015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-04ef47b1-3aa1-4824-a0ce-d224a1ca619f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:31.570060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-04ef47b1-3aa1-4824-a0ce-d224a1ca619f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:31.570942 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-04ef47b1-3aa1-4824-a0ce-d224a1ca619f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:31.644758 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0ccad6b0-daf4-46bc-a630-3616cb5aee8c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:31.658698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0ccad6b0-daf4-46bc-a630-3616cb5aee8c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.217868 May 18 17:06:31.659585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 39/84] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:31 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:31.734018 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-98f9c018-c07d-4c3d-a019-decb40961dd5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:31.734651 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-98f9c018-c07d-4c3d-a019-decb40961dd5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:31.741026 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-98f9c018-c07d-4c3d-a019-decb40961dd5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:31.741499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-98f9c018-c07d-4c3d-a019-decb40961dd5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:31.742392 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-98f9c018-c07d-4c3d-a019-decb40961dd5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:31.742833 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-98f9c018-c07d-4c3d-a019-decb40961dd5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:31.785211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-04ef47b1-3aa1-4824-a0ce-d224a1ca619f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:31.796726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-04ef47b1-3aa1-4824-a0ce-d224a1ca619f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.241062 May 18 17:06:31.797525 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 46/85] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:31 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:31.827379 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-98f9c018-c07d-4c3d-a019-decb40961dd5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:31.836076 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-98f9c018-c07d-4c3d-a019-decb40961dd5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.106342 May 18 17:06:31.836829 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 40/86] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:31 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:32.424507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1ffc4177-bca9-46e5-ab99-23db6f4c81e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:32.425838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1ffc4177-bca9-46e5-ab99-23db6f4c81e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:32.433263 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ffc4177-bca9-46e5-ab99-23db6f4c81e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:32.434727 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ffc4177-bca9-46e5-ab99-23db6f4c81e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:32.436882 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ffc4177-bca9-46e5-ab99-23db6f4c81e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:32.437870 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1ffc4177-bca9-46e5-ab99-23db6f4c81e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:32.515308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1ffc4177-bca9-46e5-ab99-23db6f4c81e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:32.524077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1ffc4177-bca9-46e5-ab99-23db6f4c81e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.103212 May 18 17:06:32.525250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 47/87] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:32 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:32.680196 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3eafc9ba-c9de-41bb-8ef5-184c4cc834d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:32.681053 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3eafc9ba-c9de-41bb-8ef5-184c4cc834d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:32.690128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=10 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:32.696910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3eafc9ba-c9de-41bb-8ef5-184c4cc834d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:32.697458 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3eafc9ba-c9de-41bb-8ef5-184c4cc834d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:32.699831 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3eafc9ba-c9de-41bb-8ef5-184c4cc834d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:32.700663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3eafc9ba-c9de-41bb-8ef5-184c4cc834d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:32.815527 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-514a8b48-ef5d-4b8a-9fe7-e6c94d3c4855 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:32.816156 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-514a8b48-ef5d-4b8a-9fe7-e6c94d3c4855 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:32.822676 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-514a8b48-ef5d-4b8a-9fe7-e6c94d3c4855 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:32.823129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-514a8b48-ef5d-4b8a-9fe7-e6c94d3c4855 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:32.824542 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-514a8b48-ef5d-4b8a-9fe7-e6c94d3c4855 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:32.825178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-514a8b48-ef5d-4b8a-9fe7-e6c94d3c4855 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:32.882678 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3eafc9ba-c9de-41bb-8ef5-184c4cc834d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:32.884948 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:32.894970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3eafc9ba-c9de-41bb-8ef5-184c4cc834d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.220049 May 18 17:06:32.895886 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 41/88] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:32 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:32.900832 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-aa416c19-a99c-49f8-a04a-b2dfdf24dff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:32.901452 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-aa416c19-a99c-49f8-a04a-b2dfdf24dff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:32.908028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa416c19-a99c-49f8-a04a-b2dfdf24dff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:32.908902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa416c19-a99c-49f8-a04a-b2dfdf24dff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:32.909712 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa416c19-a99c-49f8-a04a-b2dfdf24dff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:32.910154 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa416c19-a99c-49f8-a04a-b2dfdf24dff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:32.981621 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-aa416c19-a99c-49f8-a04a-b2dfdf24dff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:32.987605 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-514a8b48-ef5d-4b8a-9fe7-e6c94d3c4855 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:32.992031 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-aa416c19-a99c-49f8-a04a-b2dfdf24dff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.095064 May 18 17:06:32.992625 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 42/89] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:32 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:32.997182 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-514a8b48-ef5d-4b8a-9fe7-e6c94d3c4855 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.185420 May 18 17:06:32.998595 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 48/90] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:32 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:33.542411 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7b68cfbe-d798-48f5-9a3e-70906da5468c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:33.543752 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7b68cfbe-d798-48f5-9a3e-70906da5468c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:33.550115 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b68cfbe-d798-48f5-9a3e-70906da5468c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:33.550570 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b68cfbe-d798-48f5-9a3e-70906da5468c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:33.551342 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b68cfbe-d798-48f5-9a3e-70906da5468c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:33.551806 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b68cfbe-d798-48f5-9a3e-70906da5468c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:33.622306 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7b68cfbe-d798-48f5-9a3e-70906da5468c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:33.632167 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7b68cfbe-d798-48f5-9a3e-70906da5468c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.093677 May 18 17:06:33.632749 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 43/91] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:33 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:33.912947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5b82681c-9163-4d83-bee0-94795b49a637 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:33.913624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5b82681c-9163-4d83-bee0-94795b49a637 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:33.920894 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b82681c-9163-4d83-bee0-94795b49a637 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:33.921343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b82681c-9163-4d83-bee0-94795b49a637 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:33.922166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b82681c-9163-4d83-bee0-94795b49a637 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:33.922599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b82681c-9163-4d83-bee0-94795b49a637 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:34.014263 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b36621f-de96-49d9-b68a-499b77596f88 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:34.014987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5b36621f-de96-49d9-b68a-499b77596f88 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:34.025724 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b36621f-de96-49d9-b68a-499b77596f88 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:34.026732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b36621f-de96-49d9-b68a-499b77596f88 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:34.028705 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b36621f-de96-49d9-b68a-499b77596f88 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:34.029778 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b36621f-de96-49d9-b68a-499b77596f88 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:34.105186 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5b36621f-de96-49d9-b68a-499b77596f88 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:34.119671 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b36621f-de96-49d9-b68a-499b77596f88 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.110414 May 18 17:06:34.119875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5b82681c-9163-4d83-bee0-94795b49a637 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:34.128965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 44/92] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:34 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:34.128965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1673f7d9-5498-46a0-a443-93a967979e81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:34.128965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1673f7d9-5498-46a0-a443-93a967979e81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:34.135377 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1673f7d9-5498-46a0-a443-93a967979e81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:34.135861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1673f7d9-5498-46a0-a443-93a967979e81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:34.136891 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1673f7d9-5498-46a0-a443-93a967979e81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:34.137476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1673f7d9-5498-46a0-a443-93a967979e81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:34.139296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5b82681c-9163-4d83-bee0-94795b49a637 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.230038 May 18 17:06:34.149056 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 49/93] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:33 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:34.335786 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1673f7d9-5498-46a0-a443-93a967979e81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:34.344872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1673f7d9-5498-46a0-a443-93a967979e81 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.222998 May 18 17:06:34.345451 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 45/94] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:34 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:34.650516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e8bee3e9-0481-4754-b6c6-24d41e87afc7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:34.651468 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e8bee3e9-0481-4754-b6c6-24d41e87afc7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:34.659932 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8bee3e9-0481-4754-b6c6-24d41e87afc7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:34.660388 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8bee3e9-0481-4754-b6c6-24d41e87afc7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:34.661177 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8bee3e9-0481-4754-b6c6-24d41e87afc7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:34.662049 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8bee3e9-0481-4754-b6c6-24d41e87afc7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:34.732584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e8bee3e9-0481-4754-b6c6-24d41e87afc7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:34.746785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e8bee3e9-0481-4754-b6c6-24d41e87afc7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.100398 May 18 17:06:34.747791 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 50/95] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:34 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:35.137313 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7b18a8a5-5877-4eea-b0cf-65896f672ebe tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:35.137952 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7b18a8a5-5877-4eea-b0cf-65896f672ebe tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:35.144178 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b18a8a5-5877-4eea-b0cf-65896f672ebe tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:35.144632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b18a8a5-5877-4eea-b0cf-65896f672ebe tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:35.145403 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b18a8a5-5877-4eea-b0cf-65896f672ebe tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:35.145873 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b18a8a5-5877-4eea-b0cf-65896f672ebe tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:35.156556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1b3c03c8-a43f-4da5-85d0-3fce2d353974 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:35.157260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1b3c03c8-a43f-4da5-85d0-3fce2d353974 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:35.163918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b3c03c8-a43f-4da5-85d0-3fce2d353974 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:35.164444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b3c03c8-a43f-4da5-85d0-3fce2d353974 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:35.165217 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b3c03c8-a43f-4da5-85d0-3fce2d353974 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:35.165643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b3c03c8-a43f-4da5-85d0-3fce2d353974 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:35.210887 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7b18a8a5-5877-4eea-b0cf-65896f672ebe tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:35.225784 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7b18a8a5-5877-4eea-b0cf-65896f672ebe tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.092666 May 18 17:06:35.226883 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 46/96] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:35 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:35.316090 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1b3c03c8-a43f-4da5-85d0-3fce2d353974 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:35.324626 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1b3c03c8-a43f-4da5-85d0-3fce2d353974 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.171664 May 18 17:06:35.325240 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 51/97] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:35 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:35.364424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-710b054e-e770-4431-a2c2-e51902e16a72 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:35.365162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-710b054e-e770-4431-a2c2-e51902e16a72 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:35.375067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-710b054e-e770-4431-a2c2-e51902e16a72 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:35.375716 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-710b054e-e770-4431-a2c2-e51902e16a72 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:35.377009 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-710b054e-e770-4431-a2c2-e51902e16a72 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:35.377803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-710b054e-e770-4431-a2c2-e51902e16a72 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:35.522781 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-710b054e-e770-4431-a2c2-e51902e16a72 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:35.531683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-710b054e-e770-4431-a2c2-e51902e16a72 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.171395 May 18 17:06:35.532354 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 47/98] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:35 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:35.765200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5f52ecc5-d87c-4d56-a338-7574a40efaf4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:35.765843 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5f52ecc5-d87c-4d56-a338-7574a40efaf4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:35.771953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5f52ecc5-d87c-4d56-a338-7574a40efaf4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:35.772389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5f52ecc5-d87c-4d56-a338-7574a40efaf4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:35.773147 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5f52ecc5-d87c-4d56-a338-7574a40efaf4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:35.773570 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5f52ecc5-d87c-4d56-a338-7574a40efaf4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:35.840369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5f52ecc5-d87c-4d56-a338-7574a40efaf4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:35.848087 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5f52ecc5-d87c-4d56-a338-7574a40efaf4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.087843 May 18 17:06:35.848640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 52/99] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:35 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:36.243904 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f1c76dfb-3985-4236-9c9f-652628d228ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:36.244421 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f1c76dfb-3985-4236-9c9f-652628d228ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:36.251592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1c76dfb-3985-4236-9c9f-652628d228ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:36.252033 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1c76dfb-3985-4236-9c9f-652628d228ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:36.252792 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1c76dfb-3985-4236-9c9f-652628d228ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:36.253222 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1c76dfb-3985-4236-9c9f-652628d228ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:36.316257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f1c76dfb-3985-4236-9c9f-652628d228ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:36.324389 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f1c76dfb-3985-4236-9c9f-652628d228ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.083951 May 18 17:06:36.324977 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 48/100] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:36 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:36.342746 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e9e9dcc4-f157-4f28-8d4d-5988e053f473 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:36.343354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e9e9dcc4-f157-4f28-8d4d-5988e053f473 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:36.349594 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9e9dcc4-f157-4f28-8d4d-5988e053f473 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:36.350088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9e9dcc4-f157-4f28-8d4d-5988e053f473 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:36.350855 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9e9dcc4-f157-4f28-8d4d-5988e053f473 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:36.351285 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9e9dcc4-f157-4f28-8d4d-5988e053f473 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:36.491538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e9e9dcc4-f157-4f28-8d4d-5988e053f473 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:36.499937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e9e9dcc4-f157-4f28-8d4d-5988e053f473 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.161791 May 18 17:06:36.500513 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 53/101] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:36 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:36.549233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7efdb848-5d48-4253-8cc7-12d87e16eeff tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:36.549916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7efdb848-5d48-4253-8cc7-12d87e16eeff tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:36.555954 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7efdb848-5d48-4253-8cc7-12d87e16eeff tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:36.556405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7efdb848-5d48-4253-8cc7-12d87e16eeff tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:36.557167 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7efdb848-5d48-4253-8cc7-12d87e16eeff tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:36.557598 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7efdb848-5d48-4253-8cc7-12d87e16eeff tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:36.696547 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7efdb848-5d48-4253-8cc7-12d87e16eeff tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:36.705590 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7efdb848-5d48-4253-8cc7-12d87e16eeff tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.160150 May 18 17:06:36.706198 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 49/102] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:36 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:36.866038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-423c6264-b0a5-4273-9b25-cf47b8fcf4bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:36.866694 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-423c6264-b0a5-4273-9b25-cf47b8fcf4bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:36.873772 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-423c6264-b0a5-4273-9b25-cf47b8fcf4bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:36.874212 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-423c6264-b0a5-4273-9b25-cf47b8fcf4bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:36.874978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-423c6264-b0a5-4273-9b25-cf47b8fcf4bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:36.875405 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-423c6264-b0a5-4273-9b25-cf47b8fcf4bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:36.941827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-423c6264-b0a5-4273-9b25-cf47b8fcf4bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:36.950231 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-423c6264-b0a5-4273-9b25-cf47b8fcf4bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.087815 May 18 17:06:36.950803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 54/103] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:36 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:37.341678 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0de83f89-fe51-4bed-88dd-7e61cea290a5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:37.342395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0de83f89-fe51-4bed-88dd-7e61cea290a5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:37.349336 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0de83f89-fe51-4bed-88dd-7e61cea290a5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:37.349934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0de83f89-fe51-4bed-88dd-7e61cea290a5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:37.350620 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0de83f89-fe51-4bed-88dd-7e61cea290a5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:37.351046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0de83f89-fe51-4bed-88dd-7e61cea290a5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:37.429602 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0de83f89-fe51-4bed-88dd-7e61cea290a5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:37.438819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0de83f89-fe51-4bed-88dd-7e61cea290a5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1296 microversion: 2.1 time: 0.102081 May 18 17:06:37.439677 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 50/104] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:37 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1296 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:37.519699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a6912f40-9487-4108-a775-b7c271c6978b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:37.520398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a6912f40-9487-4108-a775-b7c271c6978b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:37.527844 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a6912f40-9487-4108-a775-b7c271c6978b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:37.528567 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a6912f40-9487-4108-a775-b7c271c6978b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:37.529623 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a6912f40-9487-4108-a775-b7c271c6978b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:37.530216 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a6912f40-9487-4108-a775-b7c271c6978b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:37.727877 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-df5e0998-35ab-465e-905e-de56004ecc8d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:37.731621 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-df5e0998-35ab-465e-905e-de56004ecc8d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:37.741891 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df5e0998-35ab-465e-905e-de56004ecc8d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:37.742883 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df5e0998-35ab-465e-905e-de56004ecc8d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:37.744779 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df5e0998-35ab-465e-905e-de56004ecc8d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:37.745470 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df5e0998-35ab-465e-905e-de56004ecc8d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:37.867320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a6912f40-9487-4108-a775-b7c271c6978b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:37.883305 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a6912f40-9487-4108-a775-b7c271c6978b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.367826 May 18 17:06:37.885016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 55/105] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:37 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:37.976246 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-66a82e60-802e-465b-9cb2-2462693d44e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:37.980716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-66a82e60-802e-465b-9cb2-2462693d44e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:38.002583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66a82e60-802e-465b-9cb2-2462693d44e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:38.006627 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66a82e60-802e-465b-9cb2-2462693d44e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:38.007917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66a82e60-802e-465b-9cb2-2462693d44e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:38.008888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-66a82e60-802e-465b-9cb2-2462693d44e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:38.198057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-66a82e60-802e-465b-9cb2-2462693d44e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:38.215055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-66a82e60-802e-465b-9cb2-2462693d44e1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.248226 May 18 17:06:38.216999 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 56/106] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:37 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:38.462905 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-25e8ac8c-f79c-4ada-b20d-dbb4d5a3b51a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:38.464150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-25e8ac8c-f79c-4ada-b20d-dbb4d5a3b51a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:38.481301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25e8ac8c-f79c-4ada-b20d-dbb4d5a3b51a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:38.482305 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25e8ac8c-f79c-4ada-b20d-dbb4d5a3b51a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:38.483388 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25e8ac8c-f79c-4ada-b20d-dbb4d5a3b51a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:38.486185 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25e8ac8c-f79c-4ada-b20d-dbb4d5a3b51a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:38.509570 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-df5e0998-35ab-465e-905e-de56004ecc8d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:38.539134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-df5e0998-35ab-465e-905e-de56004ecc8d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.817460 May 18 17:06:38.544083 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 51/107] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:37 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:38.749252 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-25e8ac8c-f79c-4ada-b20d-dbb4d5a3b51a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:38.751714 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:38.759098 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-25e8ac8c-f79c-4ada-b20d-dbb4d5a3b51a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1294 microversion: 2.1 time: 0.303057 May 18 17:06:38.759780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 57/108] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:38 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1294 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:38.911523 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fc6371bc-9829-43b1-8044-bf51f823dd3b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:38.912897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fc6371bc-9829-43b1-8044-bf51f823dd3b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:38.948514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fc6371bc-9829-43b1-8044-bf51f823dd3b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:38.953602 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fc6371bc-9829-43b1-8044-bf51f823dd3b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:38.959672 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fc6371bc-9829-43b1-8044-bf51f823dd3b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:38.963915 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fc6371bc-9829-43b1-8044-bf51f823dd3b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:39.236025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b1959888-0f06-488c-afe3-10a8818ef44b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:39.237013 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b1959888-0f06-488c-afe3-10a8818ef44b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:39.249414 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b1959888-0f06-488c-afe3-10a8818ef44b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:39.250235 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b1959888-0f06-488c-afe3-10a8818ef44b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:39.251241 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b1959888-0f06-488c-afe3-10a8818ef44b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:39.254706 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b1959888-0f06-488c-afe3-10a8818ef44b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:39.368658 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b1959888-0f06-488c-afe3-10a8818ef44b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:39.379372 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b1959888-0f06-488c-afe3-10a8818ef44b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1299 microversion: 2.1 time: 0.150623 May 18 17:06:39.380636 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 58/109] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:39 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1299 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:39.580351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-06e01e9c-2d82-494f-84b3-1ea154787fab tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:39.581053 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-06e01e9c-2d82-494f-84b3-1ea154787fab tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:39.596659 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06e01e9c-2d82-494f-84b3-1ea154787fab tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:39.597487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06e01e9c-2d82-494f-84b3-1ea154787fab tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:39.600116 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06e01e9c-2d82-494f-84b3-1ea154787fab tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:39.601060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06e01e9c-2d82-494f-84b3-1ea154787fab tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:39.628331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fc6371bc-9829-43b1-8044-bf51f823dd3b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:39.648257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fc6371bc-9829-43b1-8044-bf51f823dd3b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.747334 May 18 17:06:39.653917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 52/110] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:38 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:39.784182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a7530c7e-c975-421f-a749-28e40590c6eb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:39.785288 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a7530c7e-c975-421f-a749-28e40590c6eb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:39.795095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a7530c7e-c975-421f-a749-28e40590c6eb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:39.796588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a7530c7e-c975-421f-a749-28e40590c6eb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:39.797646 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a7530c7e-c975-421f-a749-28e40590c6eb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:39.802697 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a7530c7e-c975-421f-a749-28e40590c6eb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:39.963951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-06e01e9c-2d82-494f-84b3-1ea154787fab tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:40.006140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-06e01e9c-2d82-494f-84b3-1ea154787fab tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.428643 May 18 17:06:40.016640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 59/111] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:39 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:40.132559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a7530c7e-c975-421f-a749-28e40590c6eb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:40.150914 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a7530c7e-c975-421f-a749-28e40590c6eb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1294 microversion: 2.1 time: 0.375232 May 18 17:06:40.152999 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 53/112] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:39 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1294 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:40.401450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e8b62957-6af8-4559-8c4c-cae8c31f615d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:40.403312 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e8b62957-6af8-4559-8c4c-cae8c31f615d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:40.414709 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8b62957-6af8-4559-8c4c-cae8c31f615d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:40.416209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8b62957-6af8-4559-8c4c-cae8c31f615d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:40.418999 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8b62957-6af8-4559-8c4c-cae8c31f615d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:40.420307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8b62957-6af8-4559-8c4c-cae8c31f615d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:40.679072 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0e0c848b-a8c8-4480-b886-a12fdddb5941 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:40.680866 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0e0c848b-a8c8-4480-b886-a12fdddb5941 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:40.698213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e0c848b-a8c8-4480-b886-a12fdddb5941 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:40.700029 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e0c848b-a8c8-4480-b886-a12fdddb5941 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:40.704070 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e0c848b-a8c8-4480-b886-a12fdddb5941 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:40.706840 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e0c848b-a8c8-4480-b886-a12fdddb5941 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:40.822483 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e8b62957-6af8-4559-8c4c-cae8c31f615d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:40.842917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e8b62957-6af8-4559-8c4c-cae8c31f615d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.448670 May 18 17:06:40.846245 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 60/113] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:40 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:40.994793 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0e0c848b-a8c8-4480-b886-a12fdddb5941 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:41.004384 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0e0c848b-a8c8-4480-b886-a12fdddb5941 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.335584 May 18 17:06:41.014060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 54/114] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:40 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:41.027206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4be44495-08f0-4167-8a5a-ecc82f742161 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:41.028291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4be44495-08f0-4167-8a5a-ecc82f742161 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:41.039204 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4be44495-08f0-4167-8a5a-ecc82f742161 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:41.040258 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4be44495-08f0-4167-8a5a-ecc82f742161 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:41.041866 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4be44495-08f0-4167-8a5a-ecc82f742161 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:41.042898 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4be44495-08f0-4167-8a5a-ecc82f742161 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:41.171897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-570a552a-6a8b-4028-b358-3110521a8743 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:41.172744 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-570a552a-6a8b-4028-b358-3110521a8743 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:41.182026 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-570a552a-6a8b-4028-b358-3110521a8743 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:41.182969 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-570a552a-6a8b-4028-b358-3110521a8743 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:41.184818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-570a552a-6a8b-4028-b358-3110521a8743 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:41.185470 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-570a552a-6a8b-4028-b358-3110521a8743 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:41.365503 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4be44495-08f0-4167-8a5a-ecc82f742161 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:41.384339 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4be44495-08f0-4167-8a5a-ecc82f742161 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.361316 May 18 17:06:41.388937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 61/115] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:41 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:41.413580 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-570a552a-6a8b-4028-b358-3110521a8743 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:41.424642 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-570a552a-6a8b-4028-b358-3110521a8743 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.258220 May 18 17:06:41.426018 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 55/116] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:41 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:41.864901 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-506e7a92-e69c-425a-9d4e-695c734e62d9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:41.865989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-506e7a92-e69c-425a-9d4e-695c734e62d9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:41.882016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-506e7a92-e69c-425a-9d4e-695c734e62d9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:41.883937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-506e7a92-e69c-425a-9d4e-695c734e62d9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:41.885646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-506e7a92-e69c-425a-9d4e-695c734e62d9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:41.887311 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-506e7a92-e69c-425a-9d4e-695c734e62d9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:42.024258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2f37d4e5-baaf-4793-8de7-bcdea92fb51b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:42.025067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2f37d4e5-baaf-4793-8de7-bcdea92fb51b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:42.047746 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f37d4e5-baaf-4793-8de7-bcdea92fb51b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:42.048081 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f37d4e5-baaf-4793-8de7-bcdea92fb51b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:42.049382 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f37d4e5-baaf-4793-8de7-bcdea92fb51b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:42.050003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f37d4e5-baaf-4793-8de7-bcdea92fb51b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:42.126160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-506e7a92-e69c-425a-9d4e-695c734e62d9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:42.158714 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-506e7a92-e69c-425a-9d4e-695c734e62d9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.300246 May 18 17:06:42.160755 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 62/117] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:41 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:42.411040 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-63dfc299-d51c-45cf-b83f-7b657b9cbd25 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:42.411731 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-63dfc299-d51c-45cf-b83f-7b657b9cbd25 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:42.422335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-63dfc299-d51c-45cf-b83f-7b657b9cbd25 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:42.423442 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-63dfc299-d51c-45cf-b83f-7b657b9cbd25 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:42.425463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-63dfc299-d51c-45cf-b83f-7b657b9cbd25 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:42.426532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-63dfc299-d51c-45cf-b83f-7b657b9cbd25 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:42.667247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2f37d4e5-baaf-4793-8de7-bcdea92fb51b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:42.696551 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2f37d4e5-baaf-4793-8de7-bcdea92fb51b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.675664 May 18 17:06:42.717218 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 56/118] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:42 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:42.736063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2049024c-5b84-4a0e-8e74-2dfafd1b019c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:42.739089 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2049024c-5b84-4a0e-8e74-2dfafd1b019c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:42.760304 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2049024c-5b84-4a0e-8e74-2dfafd1b019c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:42.762747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2049024c-5b84-4a0e-8e74-2dfafd1b019c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:42.764878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2049024c-5b84-4a0e-8e74-2dfafd1b019c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:42.765793 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2049024c-5b84-4a0e-8e74-2dfafd1b019c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:42.789856 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-63dfc299-d51c-45cf-b83f-7b657b9cbd25 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:42.826959 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-63dfc299-d51c-45cf-b83f-7b657b9cbd25 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.417955 May 18 17:06:42.828186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 63/119] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:42 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:43.291316 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-848aa333-d183-4e98-b995-d1ba1ea6a1dd req-6b462334-8b79-4c6d-841d-175859cb9dcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9803931-931f-4c10-92de-264b813d7d3c", "name": "network-vif-plugged", "status": "completed", "tag": "9288fe21-bb66-4add-9ae5-bc39c25cdcb7"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:43.314268 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-848aa333-d183-4e98-b995-d1ba1ea6a1dd req-6b462334-8b79-4c6d-841d-175859cb9dcb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.314761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-848aa333-d183-4e98-b995-d1ba1ea6a1dd req-6b462334-8b79-4c6d-841d-175859cb9dcb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:43.360173 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-848aa333-d183-4e98-b995-d1ba1ea6a1dd req-6b462334-8b79-4c6d-841d-175859cb9dcb service nova] Creating event network-vif-plugged:9288fe21-bb66-4add-9ae5-bc39c25cdcb7 for instance e9803931-931f-4c10-92de-264b813d7d3c on hv-cinder-79578 May 18 17:06:43.361004 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-848aa333-d183-4e98-b995-d1ba1ea6a1dd req-6b462334-8b79-4c6d-841d-175859cb9dcb service nova] Acquired lock "compute-rpcapi-router" {{(pid=117732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 18 17:06:43.362463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa22b149-db70-4f23-bd9e-d67d9ddbd8fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.363070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa22b149-db70-4f23-bd9e-d67d9ddbd8fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:43.364036 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa22b149-db70-4f23-bd9e-d67d9ddbd8fe None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.364704 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa22b149-db70-4f23-bd9e-d67d9ddbd8fe None None] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:43.388083 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.compute.rpcapi [None req-fa22b149-db70-4f23-bd9e-d67d9ddbd8fe None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 18 17:06:43.389359 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa22b149-db70-4f23-bd9e-d67d9ddbd8fe None None] Releasing lock "compute-rpcapi-router" {{(pid=117732) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 18 17:06:43.434985 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fa22b149-db70-4f23-bd9e-d67d9ddbd8fe None None] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.602570 May 18 17:06:43.435888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 64/120] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:43.442528 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3c83a749-cd69-4889-82ad-b58cdd0d73e5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:43.445070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3c83a749-cd69-4889-82ad-b58cdd0d73e5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:43.466057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3c83a749-cd69-4889-82ad-b58cdd0d73e5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.466778 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3c83a749-cd69-4889-82ad-b58cdd0d73e5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:43.467723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3c83a749-cd69-4889-82ad-b58cdd0d73e5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.468315 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3c83a749-cd69-4889-82ad-b58cdd0d73e5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:43.548186 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2049024c-5b84-4a0e-8e74-2dfafd1b019c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:43.564883 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2049024c-5b84-4a0e-8e74-2dfafd1b019c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.845835 May 18 17:06:43.602641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 57/121] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:42 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:43.737706 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bb1e1b3b-26e5-4662-92a8-227d192e8881 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:43.738934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bb1e1b3b-26e5-4662-92a8-227d192e8881 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:43.761600 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb1e1b3b-26e5-4662-92a8-227d192e8881 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.765877 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb1e1b3b-26e5-4662-92a8-227d192e8881 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:43.767828 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb1e1b3b-26e5-4662-92a8-227d192e8881 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.773161 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb1e1b3b-26e5-4662-92a8-227d192e8881 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:43.820010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:43.829408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3c83a749-cd69-4889-82ad-b58cdd0d73e5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:43.837702 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3c83a749-cd69-4889-82ad-b58cdd0d73e5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.400386 May 18 17:06:43.841430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 65/122] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:43 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:43.861717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-10686f51-1d79-43e7-9f2c-b67748e34a65 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:43.862395 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-10686f51-1d79-43e7-9f2c-b67748e34a65 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:43.869880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10686f51-1d79-43e7-9f2c-b67748e34a65 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.871170 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10686f51-1d79-43e7-9f2c-b67748e34a65 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:43.872738 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10686f51-1d79-43e7-9f2c-b67748e34a65 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:43.873209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10686f51-1d79-43e7-9f2c-b67748e34a65 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:44.266298 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-10686f51-1d79-43e7-9f2c-b67748e34a65 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:44.287258 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-10686f51-1d79-43e7-9f2c-b67748e34a65 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.433457 May 18 17:06:44.288688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 66/123] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:43 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:44.629619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bf3b7908-9357-44d1-95af-0bbfac9f123d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:44.632938 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bf3b7908-9357-44d1-95af-0bbfac9f123d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:44.663657 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bf3b7908-9357-44d1-95af-0bbfac9f123d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:44.664495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bf3b7908-9357-44d1-95af-0bbfac9f123d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:44.676442 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bf3b7908-9357-44d1-95af-0bbfac9f123d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:44.677341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bf3b7908-9357-44d1-95af-0bbfac9f123d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:44.750980 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bb1e1b3b-26e5-4662-92a8-227d192e8881 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:44.758845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bb1e1b3b-26e5-4662-92a8-227d192e8881 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 1.031839 May 18 17:06:44.769639 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 58/124] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:43 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:44.867589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3489161a-4240-44d3-94b2-00c3e03f5a98 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:44.868258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3489161a-4240-44d3-94b2-00c3e03f5a98 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:44.885389 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3489161a-4240-44d3-94b2-00c3e03f5a98 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:44.886113 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3489161a-4240-44d3-94b2-00c3e03f5a98 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:44.887720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3489161a-4240-44d3-94b2-00c3e03f5a98 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:44.888283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3489161a-4240-44d3-94b2-00c3e03f5a98 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:44.897976 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bf3b7908-9357-44d1-95af-0bbfac9f123d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:44.910561 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bf3b7908-9357-44d1-95af-0bbfac9f123d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.296311 May 18 17:06:44.911482 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 67/125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:44 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:45.268987 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-56f287b3-aed4-4bbb-9b6c-0251b961e4e0 req-42e8b5f3-f156-4e5f-b0d0-3c14ee56145a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ee8046-a947-4f1c-badc-cdf4a50fcd6e", "tag": "68dda7a1-bf2e-4af2-b271-828eec9d063b"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:45.282930 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-56f287b3-aed4-4bbb-9b6c-0251b961e4e0 req-42e8b5f3-f156-4e5f-b0d0-3c14ee56145a service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:45.284172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-56f287b3-aed4-4bbb-9b6c-0251b961e4e0 req-42e8b5f3-f156-4e5f-b0d0-3c14ee56145a service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:45.307319 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-56f287b3-aed4-4bbb-9b6c-0251b961e4e0 req-42e8b5f3-f156-4e5f-b0d0-3c14ee56145a service nova] Creating event network-changed:68dda7a1-bf2e-4af2-b271-828eec9d063b for instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e on hv-cinder-79578 May 18 17:06:45.323758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-56f287b3-aed4-4bbb-9b6c-0251b961e4e0 req-42e8b5f3-f156-4e5f-b0d0-3c14ee56145a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062958 May 18 17:06:45.325911 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 68/126] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:45.332745 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-68840934-eebb-49fa-897d-7a9dbf0cdd32 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:45.333898 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-68840934-eebb-49fa-897d-7a9dbf0cdd32 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:45.345219 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-68840934-eebb-49fa-897d-7a9dbf0cdd32 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:45.346366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-68840934-eebb-49fa-897d-7a9dbf0cdd32 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:45.347572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-68840934-eebb-49fa-897d-7a9dbf0cdd32 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:45.348265 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-68840934-eebb-49fa-897d-7a9dbf0cdd32 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:45.592760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-68840934-eebb-49fa-897d-7a9dbf0cdd32 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:45.598818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3489161a-4240-44d3-94b2-00c3e03f5a98 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:45.610421 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-68840934-eebb-49fa-897d-7a9dbf0cdd32 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.282895 May 18 17:06:45.610827 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3489161a-4240-44d3-94b2-00c3e03f5a98 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.747287 May 18 17:06:45.611357 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 69/127] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:45 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:45.617945 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 59/128] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:44 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:45.783292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f16e138f-9cda-4e4f-8435-cfb3952b0a21 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:45.784633 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f16e138f-9cda-4e4f-8435-cfb3952b0a21 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:45.790954 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f16e138f-9cda-4e4f-8435-cfb3952b0a21 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:45.804674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f16e138f-9cda-4e4f-8435-cfb3952b0a21 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:45.806157 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f16e138f-9cda-4e4f-8435-cfb3952b0a21 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:45.807055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f16e138f-9cda-4e4f-8435-cfb3952b0a21 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:45.934491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-794e2a19-931f-4e1c-a751-d09db9072a3f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:45.936341 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-794e2a19-931f-4e1c-a751-d09db9072a3f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:45.944829 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-794e2a19-931f-4e1c-a751-d09db9072a3f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:45.945365 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-794e2a19-931f-4e1c-a751-d09db9072a3f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:45.946483 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-794e2a19-931f-4e1c-a751-d09db9072a3f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:45.947099 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-794e2a19-931f-4e1c-a751-d09db9072a3f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:46.028548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f16e138f-9cda-4e4f-8435-cfb3952b0a21 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:46.041103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f16e138f-9cda-4e4f-8435-cfb3952b0a21 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.261256 May 18 17:06:46.042117 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 70/129] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:45 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:46.120966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-794e2a19-931f-4e1c-a751-d09db9072a3f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:46.139518 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-794e2a19-931f-4e1c-a751-d09db9072a3f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.211678 May 18 17:06:46.140456 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 60/130] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:45 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:46.637236 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f4c8df10-3aac-464d-941f-fb462b11fb42 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:46.638586 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f4c8df10-3aac-464d-941f-fb462b11fb42 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:46.640577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-38a0b3d8-661c-4139-9216-08452fa2fb80 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:46.641729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-38a0b3d8-661c-4139-9216-08452fa2fb80 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:46.646506 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f4c8df10-3aac-464d-941f-fb462b11fb42 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:46.647166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f4c8df10-3aac-464d-941f-fb462b11fb42 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:46.648341 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f4c8df10-3aac-464d-941f-fb462b11fb42 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:46.648992 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f4c8df10-3aac-464d-941f-fb462b11fb42 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:46.650587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38a0b3d8-661c-4139-9216-08452fa2fb80 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:46.651248 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38a0b3d8-661c-4139-9216-08452fa2fb80 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:46.652716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38a0b3d8-661c-4139-9216-08452fa2fb80 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:46.653624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38a0b3d8-661c-4139-9216-08452fa2fb80 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:46.848273 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-38a0b3d8-661c-4139-9216-08452fa2fb80 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:46.857028 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-38a0b3d8-661c-4139-9216-08452fa2fb80 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.224646 May 18 17:06:46.858296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 71/131] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:46 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:46.938959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f4c8df10-3aac-464d-941f-fb462b11fb42 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:46.948513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f4c8df10-3aac-464d-941f-fb462b11fb42 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.316661 May 18 17:06:46.949867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 61/132] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:46 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:47.064893 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0af9c7ad-5c9b-42af-a787-2ef0bac716a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:47.065541 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0af9c7ad-5c9b-42af-a787-2ef0bac716a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:47.076621 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0af9c7ad-5c9b-42af-a787-2ef0bac716a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:47.077207 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0af9c7ad-5c9b-42af-a787-2ef0bac716a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:47.078193 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0af9c7ad-5c9b-42af-a787-2ef0bac716a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:47.078665 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0af9c7ad-5c9b-42af-a787-2ef0bac716a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:47.156782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-071c9d64-5036-4221-b451-edbe4110c674 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:47.157335 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-071c9d64-5036-4221-b451-edbe4110c674 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:47.160949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:47.169273 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-071c9d64-5036-4221-b451-edbe4110c674 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:47.169760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-071c9d64-5036-4221-b451-edbe4110c674 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:47.170851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-071c9d64-5036-4221-b451-edbe4110c674 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:47.172301 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-071c9d64-5036-4221-b451-edbe4110c674 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:47.325569 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0af9c7ad-5c9b-42af-a787-2ef0bac716a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:47.341177 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0af9c7ad-5c9b-42af-a787-2ef0bac716a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.280762 May 18 17:06:47.342479 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 72/133] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:47 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:47.357193 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-071c9d64-5036-4221-b451-edbe4110c674 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:47.366094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-071c9d64-5036-4221-b451-edbe4110c674 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.213454 May 18 17:06:47.367060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 62/134] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:47 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:47.392037 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-ae9dcd91-ff49-4fb5-8f77-1e243d06c68c req-c762b429-14b2-4731-bd48-931afa4133fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457f8f5f-ff7d-4484-8e29-298c7ecbee76", "tag": "574aa010-2b32-4402-9aca-f06181af0dc4"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:47.400606 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:47.404267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-ae9dcd91-ff49-4fb5-8f77-1e243d06c68c req-c762b429-14b2-4731-bd48-931afa4133fb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:47.404788 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-ae9dcd91-ff49-4fb5-8f77-1e243d06c68c req-c762b429-14b2-4731-bd48-931afa4133fb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:47.421261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-ae9dcd91-ff49-4fb5-8f77-1e243d06c68c req-c762b429-14b2-4731-bd48-931afa4133fb service nova] Creating event network-changed:574aa010-2b32-4402-9aca-f06181af0dc4 for instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 on hv-cinder-79578 May 18 17:06:47.427144 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-ae9dcd91-ff49-4fb5-8f77-1e243d06c68c req-c762b429-14b2-4731-bd48-931afa4133fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039326 May 18 17:06:47.427928 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 73/135] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:47.876443 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d7692504-7e32-46a4-9a35-a1eb006415c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:47.877063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d7692504-7e32-46a4-9a35-a1eb006415c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:47.887086 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d7692504-7e32-46a4-9a35-a1eb006415c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:47.887842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d7692504-7e32-46a4-9a35-a1eb006415c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:47.888800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d7692504-7e32-46a4-9a35-a1eb006415c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:47.889446 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d7692504-7e32-46a4-9a35-a1eb006415c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:47.968309 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b64b1fe3-c1ce-4b2f-a129-ebb7e74ffa71 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:47.970172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b64b1fe3-c1ce-4b2f-a129-ebb7e74ffa71 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:47.994405 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b64b1fe3-c1ce-4b2f-a129-ebb7e74ffa71 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:48.000342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b64b1fe3-c1ce-4b2f-a129-ebb7e74ffa71 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:48.000342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b64b1fe3-c1ce-4b2f-a129-ebb7e74ffa71 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:48.000342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b64b1fe3-c1ce-4b2f-a129-ebb7e74ffa71 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:48.147590 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d7692504-7e32-46a4-9a35-a1eb006415c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:48.168518 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d7692504-7e32-46a4-9a35-a1eb006415c3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.295019 May 18 17:06:48.169376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 63/136] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:47 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:48.233696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b64b1fe3-c1ce-4b2f-a129-ebb7e74ffa71 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:48.251769 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b64b1fe3-c1ce-4b2f-a129-ebb7e74ffa71 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.288138 May 18 17:06:48.253566 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 74/137] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:47 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:48.363748 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-005e229d-954a-4847-892a-42b2478ca215 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:48.364794 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-005e229d-954a-4847-892a-42b2478ca215 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:48.374190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-005e229d-954a-4847-892a-42b2478ca215 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:48.374876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-005e229d-954a-4847-892a-42b2478ca215 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:48.375810 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-005e229d-954a-4847-892a-42b2478ca215 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:48.376624 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-005e229d-954a-4847-892a-42b2478ca215 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:48.396948 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-abb9d9b6-f411-4496-9c2b-05ab755f2ff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:48.397900 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-abb9d9b6-f411-4496-9c2b-05ab755f2ff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:48.411106 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abb9d9b6-f411-4496-9c2b-05ab755f2ff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:48.411839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abb9d9b6-f411-4496-9c2b-05ab755f2ff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:48.416358 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abb9d9b6-f411-4496-9c2b-05ab755f2ff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:48.417095 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abb9d9b6-f411-4496-9c2b-05ab755f2ff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:48.670205 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-abb9d9b6-f411-4496-9c2b-05ab755f2ff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:48.676181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-005e229d-954a-4847-892a-42b2478ca215 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:48.681598 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-abb9d9b6-f411-4496-9c2b-05ab755f2ff0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.291026 May 18 17:06:48.682331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 75/138] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:48 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:48.686276 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-005e229d-954a-4847-892a-42b2478ca215 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.329544 May 18 17:06:48.687181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 64/139] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:48 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:49.192983 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-82cac24d-8d70-4bc3-a139-90349436aac7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:49.194337 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-82cac24d-8d70-4bc3-a139-90349436aac7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:49.202514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82cac24d-8d70-4bc3-a139-90349436aac7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:49.203701 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82cac24d-8d70-4bc3-a139-90349436aac7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:49.204885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82cac24d-8d70-4bc3-a139-90349436aac7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:49.205696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82cac24d-8d70-4bc3-a139-90349436aac7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:49.214399 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:49.273768 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-09c72399-f9d3-4eee-8dd2-71b25740a95d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:49.275836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-09c72399-f9d3-4eee-8dd2-71b25740a95d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:49.284306 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-09c72399-f9d3-4eee-8dd2-71b25740a95d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:49.285162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-09c72399-f9d3-4eee-8dd2-71b25740a95d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:49.286173 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-09c72399-f9d3-4eee-8dd2-71b25740a95d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:49.286720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-09c72399-f9d3-4eee-8dd2-71b25740a95d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:49.483620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-82cac24d-8d70-4bc3-a139-90349436aac7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:49.492200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-82cac24d-8d70-4bc3-a139-90349436aac7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.303993 May 18 17:06:49.504580 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 76/140] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:49 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:49.517211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-09c72399-f9d3-4eee-8dd2-71b25740a95d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:49.539584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-09c72399-f9d3-4eee-8dd2-71b25740a95d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.272091 May 18 17:06:49.540182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 65/141] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:49 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:49.702445 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6977c0a5-ff50-457c-8d8a-360f4bd44ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:49.703485 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6977c0a5-ff50-457c-8d8a-360f4bd44ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:49.703989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b5da13f8-0792-4ea4-bfc0-52e32f6163f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:49.704730 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b5da13f8-0792-4ea4-bfc0-52e32f6163f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:49.710948 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6977c0a5-ff50-457c-8d8a-360f4bd44ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:49.711427 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5da13f8-0792-4ea4-bfc0-52e32f6163f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:49.711986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5da13f8-0792-4ea4-bfc0-52e32f6163f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:49.712355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6977c0a5-ff50-457c-8d8a-360f4bd44ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:49.712767 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5da13f8-0792-4ea4-bfc0-52e32f6163f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:49.713464 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5da13f8-0792-4ea4-bfc0-52e32f6163f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:49.714108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6977c0a5-ff50-457c-8d8a-360f4bd44ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:49.715092 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6977c0a5-ff50-457c-8d8a-360f4bd44ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:49.926460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b5da13f8-0792-4ea4-bfc0-52e32f6163f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:49.939524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b5da13f8-0792-4ea4-bfc0-52e32f6163f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.240213 May 18 17:06:49.940292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 66/142] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:49 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:49.977954 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6977c0a5-ff50-457c-8d8a-360f4bd44ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:50.026414 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6977c0a5-ff50-457c-8d8a-360f4bd44ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.330165 May 18 17:06:50.027687 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 77/143] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:49 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:50.427070 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-0eb6b9f7-e38c-46e0-8b30-52f114f5932a req-35e6a668-f70f-4eec-92c9-efb73e31266c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1e5ac3-2af5-4bee-a830-1f6014618699", "name": "network-vif-plugged", "status": "completed", "tag": "48153f9f-0291-4a2d-98eb-9f34883f13df"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:50.459086 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-0eb6b9f7-e38c-46e0-8b30-52f114f5932a req-35e6a668-f70f-4eec-92c9-efb73e31266c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:50.462305 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-0eb6b9f7-e38c-46e0-8b30-52f114f5932a req-35e6a668-f70f-4eec-92c9-efb73e31266c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:50.513777 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-299482b0-9aff-4a75-a9a6-57d144a42bb9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:50.514672 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-299482b0-9aff-4a75-a9a6-57d144a42bb9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:50.519347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-0eb6b9f7-e38c-46e0-8b30-52f114f5932a req-35e6a668-f70f-4eec-92c9-efb73e31266c service nova] Creating event network-vif-plugged:48153f9f-0291-4a2d-98eb-9f34883f13df for instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 on hv-cinder-79578 May 18 17:06:50.535268 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-299482b0-9aff-4a75-a9a6-57d144a42bb9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:50.535792 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-299482b0-9aff-4a75-a9a6-57d144a42bb9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:50.536607 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-299482b0-9aff-4a75-a9a6-57d144a42bb9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:50.537048 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-299482b0-9aff-4a75-a9a6-57d144a42bb9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:50.544498 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-0eb6b9f7-e38c-46e0-8b30-52f114f5932a req-35e6a668-f70f-4eec-92c9-efb73e31266c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122275 May 18 17:06:50.546020 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 67/144] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:50.575875 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-993ac2ab-5b53-49a3-8586-26abbf7f34e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:50.577891 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-993ac2ab-5b53-49a3-8586-26abbf7f34e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:50.607609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-993ac2ab-5b53-49a3-8586-26abbf7f34e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:50.609171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-993ac2ab-5b53-49a3-8586-26abbf7f34e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:50.613470 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-993ac2ab-5b53-49a3-8586-26abbf7f34e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:50.616466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-993ac2ab-5b53-49a3-8586-26abbf7f34e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:50.800836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-993ac2ab-5b53-49a3-8586-26abbf7f34e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:50.823000 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-299482b0-9aff-4a75-a9a6-57d144a42bb9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:50.863658 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-299482b0-9aff-4a75-a9a6-57d144a42bb9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.355202 May 18 17:06:50.866330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 78/145] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:50 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:50.875543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-993ac2ab-5b53-49a3-8586-26abbf7f34e1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.320903 May 18 17:06:50.888338 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 68/146] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:50 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:50.957095 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-651ec2af-8fdb-448c-bd65-1fb1d4cdf8ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:50.958508 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-651ec2af-8fdb-448c-bd65-1fb1d4cdf8ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:50.969134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-651ec2af-8fdb-448c-bd65-1fb1d4cdf8ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:50.969579 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-651ec2af-8fdb-448c-bd65-1fb1d4cdf8ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:50.974406 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-651ec2af-8fdb-448c-bd65-1fb1d4cdf8ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:50.975155 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-651ec2af-8fdb-448c-bd65-1fb1d4cdf8ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:51.047887 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-93474fcd-33f2-49a5-9a81-3816b78fe19e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:51.049307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-93474fcd-33f2-49a5-9a81-3816b78fe19e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:51.060837 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-93474fcd-33f2-49a5-9a81-3816b78fe19e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:51.062302 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-93474fcd-33f2-49a5-9a81-3816b78fe19e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:51.063745 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-93474fcd-33f2-49a5-9a81-3816b78fe19e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:51.064826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-93474fcd-33f2-49a5-9a81-3816b78fe19e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:51.369227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-93474fcd-33f2-49a5-9a81-3816b78fe19e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:51.379248 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-93474fcd-33f2-49a5-9a81-3816b78fe19e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.338165 May 18 17:06:51.380556 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 69/147] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:51 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:51.531736 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-651ec2af-8fdb-448c-bd65-1fb1d4cdf8ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:51.548025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-651ec2af-8fdb-448c-bd65-1fb1d4cdf8ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.594753 May 18 17:06:51.562873 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 79/148] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:50 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:51.884911 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e05d49e8-6b24-4a85-a0c9-a9f145e189b1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:51.887781 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e05d49e8-6b24-4a85-a0c9-a9f145e189b1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:51.895996 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-16ba9c3c-a9fd-4064-9dfe-96608922b1d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:51.896879 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-16ba9c3c-a9fd-4064-9dfe-96608922b1d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:51.909765 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-16ba9c3c-a9fd-4064-9dfe-96608922b1d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:51.910532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-16ba9c3c-a9fd-4064-9dfe-96608922b1d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:51.911669 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-16ba9c3c-a9fd-4064-9dfe-96608922b1d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:51.914808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-16ba9c3c-a9fd-4064-9dfe-96608922b1d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:51.919188 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e05d49e8-6b24-4a85-a0c9-a9f145e189b1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:51.920049 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e05d49e8-6b24-4a85-a0c9-a9f145e189b1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:51.926509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e05d49e8-6b24-4a85-a0c9-a9f145e189b1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:51.927234 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e05d49e8-6b24-4a85-a0c9-a9f145e189b1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:52.147603 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-16ba9c3c-a9fd-4064-9dfe-96608922b1d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:52.160816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-16ba9c3c-a9fd-4064-9dfe-96608922b1d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.269915 May 18 17:06:52.164086 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 80/149] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:51 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:52.170162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e05d49e8-6b24-4a85-a0c9-a9f145e189b1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:52.184589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e05d49e8-6b24-4a85-a0c9-a9f145e189b1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.306637 May 18 17:06:52.185689 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 70/150] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:51 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:52.398004 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8aa8a7b2-ea0b-4b10-a21a-c1032c11e893 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:52.399012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8aa8a7b2-ea0b-4b10-a21a-c1032c11e893 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:52.405605 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8aa8a7b2-ea0b-4b10-a21a-c1032c11e893 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:52.406386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8aa8a7b2-ea0b-4b10-a21a-c1032c11e893 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:52.407369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8aa8a7b2-ea0b-4b10-a21a-c1032c11e893 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:52.407993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8aa8a7b2-ea0b-4b10-a21a-c1032c11e893 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:52.568291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-39ff853b-baaa-405d-9c36-0fd0c5e01387 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:52.569822 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-39ff853b-baaa-405d-9c36-0fd0c5e01387 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:52.580800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-39ff853b-baaa-405d-9c36-0fd0c5e01387 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:52.582462 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-39ff853b-baaa-405d-9c36-0fd0c5e01387 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:52.583418 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-39ff853b-baaa-405d-9c36-0fd0c5e01387 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:52.584074 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-39ff853b-baaa-405d-9c36-0fd0c5e01387 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:52.584886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8aa8a7b2-ea0b-4b10-a21a-c1032c11e893 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:52.594254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8aa8a7b2-ea0b-4b10-a21a-c1032c11e893 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.200055 May 18 17:06:52.595602 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 81/151] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:52 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:52.834976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-39ff853b-baaa-405d-9c36-0fd0c5e01387 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:52.842996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-39ff853b-baaa-405d-9c36-0fd0c5e01387 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.280744 May 18 17:06:52.853076 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 71/152] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:52 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:53.199481 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4acbf8b8-d599-40bf-8db7-09b624d4960f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:53.200439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4acbf8b8-d599-40bf-8db7-09b624d4960f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:53.203239 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-35d13e8b-9171-4052-9652-358c2c99afbb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:53.204562 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-35d13e8b-9171-4052-9652-358c2c99afbb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:53.210868 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35d13e8b-9171-4052-9652-358c2c99afbb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:53.211705 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35d13e8b-9171-4052-9652-358c2c99afbb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:53.212607 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35d13e8b-9171-4052-9652-358c2c99afbb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:53.213135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35d13e8b-9171-4052-9652-358c2c99afbb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:53.214206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4acbf8b8-d599-40bf-8db7-09b624d4960f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:53.214669 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4acbf8b8-d599-40bf-8db7-09b624d4960f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:53.221390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4acbf8b8-d599-40bf-8db7-09b624d4960f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:53.221390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4acbf8b8-d599-40bf-8db7-09b624d4960f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:53.387209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:53.417966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-35d13e8b-9171-4052-9652-358c2c99afbb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:53.428325 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-35d13e8b-9171-4052-9652-358c2c99afbb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.230278 May 18 17:06:53.429284 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 72/153] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:53 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:53.467351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4acbf8b8-d599-40bf-8db7-09b624d4960f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:53.476531 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4acbf8b8-d599-40bf-8db7-09b624d4960f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1314 microversion: 2.1 time: 0.294581 May 18 17:06:53.487399 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 82/154] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:53 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:53.611708 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9c1bfd30-7279-4180-8f52-b6ae2f3e72ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:53.613156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9c1bfd30-7279-4180-8f52-b6ae2f3e72ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:53.622663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9c1bfd30-7279-4180-8f52-b6ae2f3e72ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:53.623454 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9c1bfd30-7279-4180-8f52-b6ae2f3e72ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:53.624436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9c1bfd30-7279-4180-8f52-b6ae2f3e72ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:53.625106 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9c1bfd30-7279-4180-8f52-b6ae2f3e72ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:53.813025 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9c1bfd30-7279-4180-8f52-b6ae2f3e72ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:53.826366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9c1bfd30-7279-4180-8f52-b6ae2f3e72ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.218597 May 18 17:06:53.827574 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 73/155] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:53 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:53.862053 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a0c12ee8-8a4f-41e6-b48e-2a160e6f6ca5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:53.863145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a0c12ee8-8a4f-41e6-b48e-2a160e6f6ca5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:53.898135 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0c12ee8-8a4f-41e6-b48e-2a160e6f6ca5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:53.901012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0c12ee8-8a4f-41e6-b48e-2a160e6f6ca5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:53.906624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0c12ee8-8a4f-41e6-b48e-2a160e6f6ca5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:53.908068 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a0c12ee8-8a4f-41e6-b48e-2a160e6f6ca5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:54.220946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a0c12ee8-8a4f-41e6-b48e-2a160e6f6ca5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:54.232057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a0c12ee8-8a4f-41e6-b48e-2a160e6f6ca5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.375092 May 18 17:06:54.241924 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 83/156] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:53 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:54.432241 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-c2ffffb6-145e-4c0b-b3a2-a138c2b4ff6c req-07ccec84-7243-45ce-895d-9fba9331e063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5c3626-81f9-412a-9759-82527b75e30e", "name": "network-vif-plugged", "status": "completed", "tag": "8a8ee3d0-ac7c-4e62-9f8b-23af1601e83f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:54.450617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-eaa816a2-4838-47cb-80b6-68b599f148bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:54.456337 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-eaa816a2-4838-47cb-80b6-68b599f148bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:54.463857 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c2ffffb6-145e-4c0b-b3a2-a138c2b4ff6c req-07ccec84-7243-45ce-895d-9fba9331e063 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:54.471030 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c2ffffb6-145e-4c0b-b3a2-a138c2b4ff6c req-07ccec84-7243-45ce-895d-9fba9331e063 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:54.476984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eaa816a2-4838-47cb-80b6-68b599f148bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:54.482197 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eaa816a2-4838-47cb-80b6-68b599f148bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:54.483754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eaa816a2-4838-47cb-80b6-68b599f148bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:54.484548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eaa816a2-4838-47cb-80b6-68b599f148bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:54.510400 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-c2ffffb6-145e-4c0b-b3a2-a138c2b4ff6c req-07ccec84-7243-45ce-895d-9fba9331e063 service nova] Creating event network-vif-plugged:8a8ee3d0-ac7c-4e62-9f8b-23af1601e83f for instance 7f5c3626-81f9-412a-9759-82527b75e30e on hv-cinder-79578 May 18 17:06:54.520972 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-c2ffffb6-145e-4c0b-b3a2-a138c2b4ff6c req-07ccec84-7243-45ce-895d-9fba9331e063 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095536 May 18 17:06:54.521593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 74/157] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:06:54.528534 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7a6388d0-b9a3-4ea2-a0f9-cb48daf08371 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:54.529420 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7a6388d0-b9a3-4ea2-a0f9-cb48daf08371 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:54.537241 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a6388d0-b9a3-4ea2-a0f9-cb48daf08371 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:54.537721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a6388d0-b9a3-4ea2-a0f9-cb48daf08371 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:54.538718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a6388d0-b9a3-4ea2-a0f9-cb48daf08371 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:54.539157 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a6388d0-b9a3-4ea2-a0f9-cb48daf08371 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:54.709797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eaa816a2-4838-47cb-80b6-68b599f148bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:54.720450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-eaa816a2-4838-47cb-80b6-68b599f148bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.277315 May 18 17:06:54.721640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 84/158] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:54 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:54.729166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7a6388d0-b9a3-4ea2-a0f9-cb48daf08371 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:54.740331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7a6388d0-b9a3-4ea2-a0f9-cb48daf08371 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1501 microversion: 2.1 time: 0.217193 May 18 17:06:54.741645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 75/159] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:54 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1501 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:54.845943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6fc58419-732e-463c-95de-bcac4da849cc tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:54.846613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6fc58419-732e-463c-95de-bcac4da849cc tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:54.858454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fc58419-732e-463c-95de-bcac4da849cc tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:54.859228 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fc58419-732e-463c-95de-bcac4da849cc tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:54.860336 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fc58419-732e-463c-95de-bcac4da849cc tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:54.862758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fc58419-732e-463c-95de-bcac4da849cc tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:55.090384 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6fc58419-732e-463c-95de-bcac4da849cc tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:55.100828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6fc58419-732e-463c-95de-bcac4da849cc tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.259198 May 18 17:06:55.102894 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 85/160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:54 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:55.249145 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a7768dd3-2b8b-424d-a125-d78f0e73937a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:55.249905 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a7768dd3-2b8b-424d-a125-d78f0e73937a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:55.268971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a7768dd3-2b8b-424d-a125-d78f0e73937a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:55.270060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a7768dd3-2b8b-424d-a125-d78f0e73937a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:55.272146 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a7768dd3-2b8b-424d-a125-d78f0e73937a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:55.272747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a7768dd3-2b8b-424d-a125-d78f0e73937a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:55.303042 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:06:55.741166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0f3a5b5b-6fcf-45a8-b261-eaa2916147f0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:55.742179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0f3a5b5b-6fcf-45a8-b261-eaa2916147f0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:55.763217 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f3a5b5b-6fcf-45a8-b261-eaa2916147f0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:55.764465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f3a5b5b-6fcf-45a8-b261-eaa2916147f0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:55.769253 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f3a5b5b-6fcf-45a8-b261-eaa2916147f0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:55.769950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0f3a5b5b-6fcf-45a8-b261-eaa2916147f0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:55.828253 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a7768dd3-2b8b-424d-a125-d78f0e73937a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:55.842121 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a7768dd3-2b8b-424d-a125-d78f0e73937a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.597064 May 18 17:06:55.842728 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 76/161] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:55 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:55.993340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0f3a5b5b-6fcf-45a8-b261-eaa2916147f0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:56.010452 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0f3a5b5b-6fcf-45a8-b261-eaa2916147f0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.273735 May 18 17:06:56.011641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 86/162] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:55 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:56.129997 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7ae3781c-090b-4346-9dfa-082a38dbd161 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:56.135232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7ae3781c-090b-4346-9dfa-082a38dbd161 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:56.152718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7ae3781c-090b-4346-9dfa-082a38dbd161 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:56.155059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7ae3781c-090b-4346-9dfa-082a38dbd161 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:56.159437 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7ae3781c-090b-4346-9dfa-082a38dbd161 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:56.162532 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7ae3781c-090b-4346-9dfa-082a38dbd161 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:56.353189 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f2e22972-d68f-4785-9826-97a2fe986ce5 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8da92b93-3b84-4f59-818b-3e4020816219"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:56.354403 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f2e22972-d68f-4785-9826-97a2fe986ce5 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:56.364206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f2e22972-d68f-4785-9826-97a2fe986ce5 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:56.364653 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f2e22972-d68f-4785-9826-97a2fe986ce5 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:56.365646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f2e22972-d68f-4785-9826-97a2fe986ce5 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:56.366296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f2e22972-d68f-4785-9826-97a2fe986ce5 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:56.527971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7ae3781c-090b-4346-9dfa-082a38dbd161 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:56.536876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7ae3781c-090b-4346-9dfa-082a38dbd161 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.420630 May 18 17:06:56.537630 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 77/163] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:56 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:56.544851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1751510753", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:06:56.640126 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] validate_networks() for None {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:06:57.160930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:06:57.161578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:06:57.162064 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:06:57.162346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:06:57.162715 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:06:57.186586 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:57.187517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:57.188649 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:57.189595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:57.215469 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Getting quotas for project 9720855c0c984b038348a02ce872b7ae. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:06:57.221043 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Getting quotas for user 816046b774504e6fabbe136e42335b82 and project 9720855c0c984b038348a02ce872b7ae. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:06:57.238219 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:06:57.241197 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:06:57.315360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-921becbb-327b-4a88-80d3-394076a0c89d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776068 May 18 17:06:57.324802 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 78/164] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:06:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:06:57.336928 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2614e9b2-d50e-4704-8a46-376c5c620112 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:57.338063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2614e9b2-d50e-4704-8a46-376c5c620112 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:57.353033 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2614e9b2-d50e-4704-8a46-376c5c620112 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:57.353491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2614e9b2-d50e-4704-8a46-376c5c620112 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:57.356923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2614e9b2-d50e-4704-8a46-376c5c620112 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:57.357806 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2614e9b2-d50e-4704-8a46-376c5c620112 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:57.681066 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2614e9b2-d50e-4704-8a46-376c5c620112 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:57.692151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2614e9b2-d50e-4704-8a46-376c5c620112 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.368623 May 18 17:06:57.693446 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 79/165] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:57 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:57.701327 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a6ddaac6-de3a-4743-9b8e-3af42bf6bff6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:57.702043 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a6ddaac6-de3a-4743-9b8e-3af42bf6bff6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:57.710515 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6ddaac6-de3a-4743-9b8e-3af42bf6bff6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:57.711220 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6ddaac6-de3a-4743-9b8e-3af42bf6bff6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:57.712644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6ddaac6-de3a-4743-9b8e-3af42bf6bff6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:57.713488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6ddaac6-de3a-4743-9b8e-3af42bf6bff6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:57.883466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a6ddaac6-de3a-4743-9b8e-3af42bf6bff6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:57.896590 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a6ddaac6-de3a-4743-9b8e-3af42bf6bff6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.200623 May 18 17:06:57.898278 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 80/166] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:57 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:57.908561 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-840ba701-8512-4c86-a539-ab6d7867292d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:57.910548 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-840ba701-8512-4c86-a539-ab6d7867292d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:57.999142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-840ba701-8512-4c86-a539-ab6d7867292d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:58.015037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-840ba701-8512-4c86-a539-ab6d7867292d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1215 microversion: 2.1 time: 0.114995 May 18 17:06:58.016529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 81/167] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:57 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:58.022679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-efef8793-4a87-45f6-ba77-628149344dce tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:58.023446 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-efef8793-4a87-45f6-ba77-628149344dce tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:58.030911 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-efef8793-4a87-45f6-ba77-628149344dce tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:58.031743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-efef8793-4a87-45f6-ba77-628149344dce tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:58.033010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-efef8793-4a87-45f6-ba77-628149344dce tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:58.033634 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-efef8793-4a87-45f6-ba77-628149344dce tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:58.229804 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-efef8793-4a87-45f6-ba77-628149344dce tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:58.238783 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-efef8793-4a87-45f6-ba77-628149344dce tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.221072 May 18 17:06:58.239370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 82/168] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:58 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:58.710486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-45021b84-5bd8-4efd-91df-ad58c2368fef tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:58.711667 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-45021b84-5bd8-4efd-91df-ad58c2368fef tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:58.719075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45021b84-5bd8-4efd-91df-ad58c2368fef tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:58.719816 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45021b84-5bd8-4efd-91df-ad58c2368fef tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:58.720857 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45021b84-5bd8-4efd-91df-ad58c2368fef tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:58.721628 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45021b84-5bd8-4efd-91df-ad58c2368fef tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:58.899691 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-45021b84-5bd8-4efd-91df-ad58c2368fef tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:58.908126 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-45021b84-5bd8-4efd-91df-ad58c2368fef tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1322 microversion: 2.1 time: 0.201417 May 18 17:06:58.909136 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 83/169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:58 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:58.924363 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5fdf8ca5-5a5c-4fd7-a172-cf876a36ebad tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:58.925378 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5fdf8ca5-5a5c-4fd7-a172-cf876a36ebad tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:58.931485 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fdf8ca5-5a5c-4fd7-a172-cf876a36ebad tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:58.931936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fdf8ca5-5a5c-4fd7-a172-cf876a36ebad tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:58.932746 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fdf8ca5-5a5c-4fd7-a172-cf876a36ebad tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:58.933179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fdf8ca5-5a5c-4fd7-a172-cf876a36ebad tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:59.102856 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5fdf8ca5-5a5c-4fd7-a172-cf876a36ebad tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:59.111738 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5fdf8ca5-5a5c-4fd7-a172-cf876a36ebad tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.191841 May 18 17:06:59.112328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 84/170] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:58 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:59.116738 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c39e923f-c06e-49de-815c-f52a9484f735 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:59.117339 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c39e923f-c06e-49de-815c-f52a9484f735 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:59.129921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c39e923f-c06e-49de-815c-f52a9484f735 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:59.130822 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c39e923f-c06e-49de-815c-f52a9484f735 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:59.131796 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c39e923f-c06e-49de-815c-f52a9484f735 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:59.132298 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c39e923f-c06e-49de-815c-f52a9484f735 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:59.208848 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c39e923f-c06e-49de-815c-f52a9484f735 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:59.217721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c39e923f-c06e-49de-815c-f52a9484f735 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1219 microversion: 2.1 time: 0.104298 May 18 17:06:59.218563 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 85/171] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:59 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:06:59.261120 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-046c8739-61b7-4979-8136-776e6cf29e56 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:59.263786 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-046c8739-61b7-4979-8136-776e6cf29e56 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:59.278870 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-046c8739-61b7-4979-8136-776e6cf29e56 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:59.279692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-046c8739-61b7-4979-8136-776e6cf29e56 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:59.280700 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-046c8739-61b7-4979-8136-776e6cf29e56 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:59.281790 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-046c8739-61b7-4979-8136-776e6cf29e56 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:59.445195 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-046c8739-61b7-4979-8136-776e6cf29e56 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:06:59.454060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-046c8739-61b7-4979-8136-776e6cf29e56 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.200774 May 18 17:06:59.454927 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 86/172] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:59 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:06:59.927823 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-83d51b06-0dee-4363-a67c-46a9c8853a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:06:59.928414 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-83d51b06-0dee-4363-a67c-46a9c8853a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:06:59.936419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-83d51b06-0dee-4363-a67c-46a9c8853a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:59.937065 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-83d51b06-0dee-4363-a67c-46a9c8853a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:06:59.938426 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-83d51b06-0dee-4363-a67c-46a9c8853a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:06:59.939070 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-83d51b06-0dee-4363-a67c-46a9c8853a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.090258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-83d51b06-0dee-4363-a67c-46a9c8853a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:00.100872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-83d51b06-0dee-4363-a67c-46a9c8853a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1516 microversion: 2.1 time: 0.177798 May 18 17:07:00.101873 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 87/173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:06:59 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1516 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:00.118721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9c2dc6fc-a395-43b6-b995-449c7391fd8d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:00.119844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9c2dc6fc-a395-43b6-b995-449c7391fd8d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:00.126712 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9c2dc6fc-a395-43b6-b995-449c7391fd8d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.127531 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9c2dc6fc-a395-43b6-b995-449c7391fd8d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.128567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9c2dc6fc-a395-43b6-b995-449c7391fd8d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.129157 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9c2dc6fc-a395-43b6-b995-449c7391fd8d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.194960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-9c2dc6fc-a395-43b6-b995-449c7391fd8d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lazy-loading 'flavor' on Instance uuid 7f5c3626-81f9-412a-9759-82527b75e30e {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:07:00.528196 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9c2dc6fc-a395-43b6-b995-449c7391fd8d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e/action" status: 200 len: 32 microversion: 2.1 time: 0.413360 May 18 17:07:00.529881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 88/174] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:07:00 2022] POST /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 18 17:07:00.537973 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9aa0aaa6-9df0-4a87-a2bf-4429a4793d08 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:00.539438 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9aa0aaa6-9df0-4a87-a2bf-4429a4793d08 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:00.547413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9aa0aaa6-9df0-4a87-a2bf-4429a4793d08 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.547859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9aa0aaa6-9df0-4a87-a2bf-4429a4793d08 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.548618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9aa0aaa6-9df0-4a87-a2bf-4429a4793d08 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.549043 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9aa0aaa6-9df0-4a87-a2bf-4429a4793d08 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.684430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9aa0aaa6-9df0-4a87-a2bf-4429a4793d08 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:00.692552 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9aa0aaa6-9df0-4a87-a2bf-4429a4793d08 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.161317 May 18 17:07:00.693155 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 89/175] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:00 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:00.698178 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-451a7958-f9d8-449d-b08a-a2b1064af1d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:00.699479 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-451a7958-f9d8-449d-b08a-a2b1064af1d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:00.706231 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-451a7958-f9d8-449d-b08a-a2b1064af1d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.706682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-451a7958-f9d8-449d-b08a-a2b1064af1d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.707722 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-451a7958-f9d8-449d-b08a-a2b1064af1d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.708162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-451a7958-f9d8-449d-b08a-a2b1064af1d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.771819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-451a7958-f9d8-449d-b08a-a2b1064af1d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:00.780493 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-451a7958-f9d8-449d-b08a-a2b1064af1d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1211 microversion: 2.1 time: 0.086157 May 18 17:07:00.781086 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 90/176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:00 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:00.785685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1dedda94-8bcf-4203-ace9-24848a1be516 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:00.786476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1dedda94-8bcf-4203-ace9-24848a1be516 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:00.793189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1dedda94-8bcf-4203-ace9-24848a1be516 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.793910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1dedda94-8bcf-4203-ace9-24848a1be516 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.794837 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1dedda94-8bcf-4203-ace9-24848a1be516 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.795405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1dedda94-8bcf-4203-ace9-24848a1be516 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.937164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1dedda94-8bcf-4203-ace9-24848a1be516 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:00.944655 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1dedda94-8bcf-4203-ace9-24848a1be516 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.162416 May 18 17:07:00.945230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 91/177] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:00 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:00.949917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a0b7e454-06f5-4461-9425-3aefb3f21cb0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:00.950724 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a0b7e454-06f5-4461-9425-3aefb3f21cb0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:00.958754 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a0b7e454-06f5-4461-9425-3aefb3f21cb0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.959265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a0b7e454-06f5-4461-9425-3aefb3f21cb0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:00.960237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a0b7e454-06f5-4461-9425-3aefb3f21cb0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:00.960876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a0b7e454-06f5-4461-9425-3aefb3f21cb0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:01.115937 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a0b7e454-06f5-4461-9425-3aefb3f21cb0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:01.119390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:01.135252 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a0b7e454-06f5-4461-9425-3aefb3f21cb0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.188783 May 18 17:07:01.137896 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 92/178] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:00 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:01.712858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dfc73626-e60d-4fc6-9bf4-8dfa8a46aba5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:01.714919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dfc73626-e60d-4fc6-9bf4-8dfa8a46aba5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:01.724705 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfc73626-e60d-4fc6-9bf4-8dfa8a46aba5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:01.725290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfc73626-e60d-4fc6-9bf4-8dfa8a46aba5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:01.726843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfc73626-e60d-4fc6-9bf4-8dfa8a46aba5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:01.727290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfc73626-e60d-4fc6-9bf4-8dfa8a46aba5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:01.892450 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dfc73626-e60d-4fc6-9bf4-8dfa8a46aba5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:01.900667 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dfc73626-e60d-4fc6-9bf4-8dfa8a46aba5 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.192980 May 18 17:07:01.902389 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 93/179] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:01 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:01.907318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8d04f5aa-0061-4a01-a21a-4ad86913f3d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:01.907997 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8d04f5aa-0061-4a01-a21a-4ad86913f3d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:01.914702 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d04f5aa-0061-4a01-a21a-4ad86913f3d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:01.915364 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d04f5aa-0061-4a01-a21a-4ad86913f3d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:01.916137 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d04f5aa-0061-4a01-a21a-4ad86913f3d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:01.916571 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8d04f5aa-0061-4a01-a21a-4ad86913f3d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:01.981012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8d04f5aa-0061-4a01-a21a-4ad86913f3d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:01.988550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8d04f5aa-0061-4a01-a21a-4ad86913f3d4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1211 microversion: 2.1 time: 0.084760 May 18 17:07:01.989126 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 94/180] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:01 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1211 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:01.993734 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc97bdad-0911-4e18-9a69-e38d2b0e6fa7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:01.994575 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bc97bdad-0911-4e18-9a69-e38d2b0e6fa7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:02.000477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc97bdad-0911-4e18-9a69-e38d2b0e6fa7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:02.000924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc97bdad-0911-4e18-9a69-e38d2b0e6fa7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:02.001741 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc97bdad-0911-4e18-9a69-e38d2b0e6fa7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:02.002181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc97bdad-0911-4e18-9a69-e38d2b0e6fa7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:02.143379 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bc97bdad-0911-4e18-9a69-e38d2b0e6fa7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:02.151030 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bc97bdad-0911-4e18-9a69-e38d2b0e6fa7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.160850 May 18 17:07:02.151850 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 95/181] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:01 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:02.156740 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0e02ae53-5126-4485-ae9d-5fe211fa81c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:02.157354 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0e02ae53-5126-4485-ae9d-5fe211fa81c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:02.163775 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e02ae53-5126-4485-ae9d-5fe211fa81c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:02.164361 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e02ae53-5126-4485-ae9d-5fe211fa81c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:02.165029 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e02ae53-5126-4485-ae9d-5fe211fa81c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:02.165502 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0e02ae53-5126-4485-ae9d-5fe211fa81c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:02.313935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0e02ae53-5126-4485-ae9d-5fe211fa81c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:02.321713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0e02ae53-5126-4485-ae9d-5fe211fa81c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.168734 May 18 17:07:02.322263 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 96/182] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:02 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:02.608764 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-c0e1c7a3-4ee3-428b-8f8c-59dcbf50dff4 req-c439a27a-31e5-4b05-88d6-492840cb0444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ee8046-a947-4f1c-badc-cdf4a50fcd6e", "name": "network-vif-plugged", "status": "completed", "tag": "68dda7a1-bf2e-4af2-b271-828eec9d063b"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:02.617476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c0e1c7a3-4ee3-428b-8f8c-59dcbf50dff4 req-c439a27a-31e5-4b05-88d6-492840cb0444 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:02.618014 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c0e1c7a3-4ee3-428b-8f8c-59dcbf50dff4 req-c439a27a-31e5-4b05-88d6-492840cb0444 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:02.631168 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-c0e1c7a3-4ee3-428b-8f8c-59dcbf50dff4 req-c439a27a-31e5-4b05-88d6-492840cb0444 service nova] Creating event network-vif-plugged:68dda7a1-bf2e-4af2-b271-828eec9d063b for instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e on hv-cinder-79578 May 18 17:07:02.637295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-c0e1c7a3-4ee3-428b-8f8c-59dcbf50dff4 req-c439a27a-31e5-4b05-88d6-492840cb0444 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031982 May 18 17:07:02.637948 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 97/183] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:07:02.923455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1f4df9bb-cbb3-4018-ba4f-63ecc67059d7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:02.924367 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1f4df9bb-cbb3-4018-ba4f-63ecc67059d7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:02.937467 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f4df9bb-cbb3-4018-ba4f-63ecc67059d7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:02.938439 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f4df9bb-cbb3-4018-ba4f-63ecc67059d7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:02.939462 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f4df9bb-cbb3-4018-ba4f-63ecc67059d7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:02.940113 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f4df9bb-cbb3-4018-ba4f-63ecc67059d7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:03.121175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f2e22972-d68f-4785-9826-97a2fe986ce5 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "POST /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.772641 May 18 17:07:03.128628 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 87/184] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:06:56 2022] POST /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c/os-volume_attachments => generated 194 bytes in 6776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:03.138165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5549854b-7771-4e8d-9072-1962b6a5e25f tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:03.142491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5549854b-7771-4e8d-9072-1962b6a5e25f tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:03.156757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5549854b-7771-4e8d-9072-1962b6a5e25f tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:03.157805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5549854b-7771-4e8d-9072-1962b6a5e25f tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:03.159527 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5549854b-7771-4e8d-9072-1962b6a5e25f tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:03.160400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5549854b-7771-4e8d-9072-1962b6a5e25f tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:03.269126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5549854b-7771-4e8d-9072-1962b6a5e25f tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:03.277134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5549854b-7771-4e8d-9072-1962b6a5e25f tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1267 microversion: 2.1 time: 0.153660 May 18 17:07:03.277739 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 88/185] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:03 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:03.282975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d86beb9e-d654-4b33-87d6-d26b327c98aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:03.283585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d86beb9e-d654-4b33-87d6-d26b327c98aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:03.287586 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1f4df9bb-cbb3-4018-ba4f-63ecc67059d7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:03.290033 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d86beb9e-d654-4b33-87d6-d26b327c98aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:03.290497 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d86beb9e-d654-4b33-87d6-d26b327c98aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:03.291273 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d86beb9e-d654-4b33-87d6-d26b327c98aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:03.291712 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d86beb9e-d654-4b33-87d6-d26b327c98aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:03.298400 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1f4df9bb-cbb3-4018-ba4f-63ecc67059d7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.379138 May 18 17:07:03.298989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 98/186] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:02 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:03.349499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-67ac14f6-5025-4122-9182-941ade2b60eb tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:03.350463 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-67ac14f6-5025-4122-9182-941ade2b60eb tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:03.361647 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67ac14f6-5025-4122-9182-941ade2b60eb tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:03.362502 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67ac14f6-5025-4122-9182-941ade2b60eb tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:03.363893 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67ac14f6-5025-4122-9182-941ade2b60eb tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:03.364696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67ac14f6-5025-4122-9182-941ade2b60eb tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:03.458878 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d86beb9e-d654-4b33-87d6-d26b327c98aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:03.468460 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d86beb9e-d654-4b33-87d6-d26b327c98aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.189216 May 18 17:07:03.469043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 89/187] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:03 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:03.524529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-67ac14f6-5025-4122-9182-941ade2b60eb tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:03.532573 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-67ac14f6-5025-4122-9182-941ade2b60eb tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.196553 May 18 17:07:03.533143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 99/188] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:03 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:04.297933 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dada2230-d2a2-40ac-b894-1233560e4b96 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:04.298612 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dada2230-d2a2-40ac-b894-1233560e4b96 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:04.304884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dada2230-d2a2-40ac-b894-1233560e4b96 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:04.305415 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dada2230-d2a2-40ac-b894-1233560e4b96 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:04.306301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dada2230-d2a2-40ac-b894-1233560e4b96 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:04.306728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dada2230-d2a2-40ac-b894-1233560e4b96 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:04.314720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-731fd859-a87e-4c99-aa90-d384fdc9271c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:04.315330 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-731fd859-a87e-4c99-aa90-d384fdc9271c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:04.321517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-731fd859-a87e-4c99-aa90-d384fdc9271c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:04.321998 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-731fd859-a87e-4c99-aa90-d384fdc9271c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:04.322966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-731fd859-a87e-4c99-aa90-d384fdc9271c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:04.323460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-731fd859-a87e-4c99-aa90-d384fdc9271c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:04.375227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dada2230-d2a2-40ac-b894-1233560e4b96 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:04.389975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dada2230-d2a2-40ac-b894-1233560e4b96 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1275 microversion: 2.1 time: 0.099288 May 18 17:07:04.390879 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 90/189] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:04 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1275 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:04.486131 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7f2491d9-76cd-4bac-9dbc-13be7aa68440 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:04.486823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7f2491d9-76cd-4bac-9dbc-13be7aa68440 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:04.493242 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7f2491d9-76cd-4bac-9dbc-13be7aa68440 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:04.493807 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7f2491d9-76cd-4bac-9dbc-13be7aa68440 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:04.494563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7f2491d9-76cd-4bac-9dbc-13be7aa68440 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:04.494995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7f2491d9-76cd-4bac-9dbc-13be7aa68440 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:04.509904 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:04.525808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-731fd859-a87e-4c99-aa90-d384fdc9271c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:04.543343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-731fd859-a87e-4c99-aa90-d384fdc9271c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.231711 May 18 17:07:04.545299 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 100/190] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:04 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:04.552655 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a5784f4c-22cd-432e-88c0-ceab4835288a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:04.553253 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a5784f4c-22cd-432e-88c0-ceab4835288a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:04.560139 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5784f4c-22cd-432e-88c0-ceab4835288a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:04.560733 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5784f4c-22cd-432e-88c0-ceab4835288a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:04.561585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5784f4c-22cd-432e-88c0-ceab4835288a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:04.562238 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5784f4c-22cd-432e-88c0-ceab4835288a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:04.699216 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a5784f4c-22cd-432e-88c0-ceab4835288a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:04.701953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7f2491d9-76cd-4bac-9dbc-13be7aa68440 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:04.707487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a5784f4c-22cd-432e-88c0-ceab4835288a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.158521 May 18 17:07:04.708198 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 101/191] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:04 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:04.710951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7f2491d9-76cd-4bac-9dbc-13be7aa68440 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.228587 May 18 17:07:04.721895 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 91/192] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:04 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:05.407477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ac07e7c8-166e-406b-adce-66229ff496dc tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:05.408096 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ac07e7c8-166e-406b-adce-66229ff496dc tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:05.414199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c8-166e-406b-adce-66229ff496dc tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:05.414647 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c8-166e-406b-adce-66229ff496dc tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:05.415419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c8-166e-406b-adce-66229ff496dc tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:05.415859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ac07e7c8-166e-406b-adce-66229ff496dc tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:05.486085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ac07e7c8-166e-406b-adce-66229ff496dc tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:05.493943 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ac07e7c8-166e-406b-adce-66229ff496dc tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1275 microversion: 2.1 time: 0.090253 May 18 17:07:05.494522 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 102/193] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:05 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:05.561353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bb33713d-0adb-4952-be2f-8b5cc39e5c78 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:05.562111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bb33713d-0adb-4952-be2f-8b5cc39e5c78 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:05.568746 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb33713d-0adb-4952-be2f-8b5cc39e5c78 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:05.569256 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb33713d-0adb-4952-be2f-8b5cc39e5c78 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:05.570235 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb33713d-0adb-4952-be2f-8b5cc39e5c78 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:05.570674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb33713d-0adb-4952-be2f-8b5cc39e5c78 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:05.715521 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb33713d-0adb-4952-be2f-8b5cc39e5c78 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:05.725142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-26a08df6-f714-45a6-a1d9-5f60b74670a0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:05.725795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bb33713d-0adb-4952-be2f-8b5cc39e5c78 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.169247 May 18 17:07:05.726480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-26a08df6-f714-45a6-a1d9-5f60b74670a0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:05.727519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 92/194] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:05 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:05.734046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-26a08df6-f714-45a6-a1d9-5f60b74670a0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:05.734782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-26a08df6-f714-45a6-a1d9-5f60b74670a0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:05.735875 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-26a08df6-f714-45a6-a1d9-5f60b74670a0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:05.736528 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-26a08df6-f714-45a6-a1d9-5f60b74670a0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:05.739622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-98dc4346-b8a7-4a35-a645-77c39a061e36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:05.740605 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-98dc4346-b8a7-4a35-a645-77c39a061e36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:05.750794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-98dc4346-b8a7-4a35-a645-77c39a061e36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:05.751306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-98dc4346-b8a7-4a35-a645-77c39a061e36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:05.752098 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-98dc4346-b8a7-4a35-a645-77c39a061e36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:05.752537 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-98dc4346-b8a7-4a35-a645-77c39a061e36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:05.915241 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-98dc4346-b8a7-4a35-a645-77c39a061e36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:05.937765 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-98dc4346-b8a7-4a35-a645-77c39a061e36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.209134 May 18 17:07:05.938349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 93/195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:05 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:05.941764 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-26a08df6-f714-45a6-a1d9-5f60b74670a0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:05.950792 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-26a08df6-f714-45a6-a1d9-5f60b74670a0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.229994 May 18 17:07:05.951366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 103/196] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:05 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:06.510702 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ee3dd774-6e58-45f1-a559-c0471da9b51e tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:06.514369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ee3dd774-6e58-45f1-a559-c0471da9b51e tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:06.518058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ee3dd774-6e58-45f1-a559-c0471da9b51e tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:06.518587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ee3dd774-6e58-45f1-a559-c0471da9b51e tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:06.519433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ee3dd774-6e58-45f1-a559-c0471da9b51e tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:06.519968 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ee3dd774-6e58-45f1-a559-c0471da9b51e tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:06.586471 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ee3dd774-6e58-45f1-a559-c0471da9b51e tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:06.595885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ee3dd774-6e58-45f1-a559-c0471da9b51e tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1275 microversion: 2.1 time: 0.088951 May 18 17:07:06.596750 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 94/197] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:06 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:06.743801 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-46005e93-e73c-49ee-9312-ba6602023afc tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:06.744721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-46005e93-e73c-49ee-9312-ba6602023afc tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:06.746915 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:06.752430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46005e93-e73c-49ee-9312-ba6602023afc tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:06.752965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46005e93-e73c-49ee-9312-ba6602023afc tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:06.753872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46005e93-e73c-49ee-9312-ba6602023afc tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:06.754381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46005e93-e73c-49ee-9312-ba6602023afc tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:06.892471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-46005e93-e73c-49ee-9312-ba6602023afc tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:06.900989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-46005e93-e73c-49ee-9312-ba6602023afc tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.161660 May 18 17:07:06.902381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 104/198] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:06 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:06.955258 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a85946a7-5bb8-4292-8491-021557da0472 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:06.955896 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a85946a7-5bb8-4292-8491-021557da0472 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:06.961812 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a85946a7-5bb8-4292-8491-021557da0472 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:06.962340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a85946a7-5bb8-4292-8491-021557da0472 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:06.963522 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a85946a7-5bb8-4292-8491-021557da0472 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:06.964589 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a85946a7-5bb8-4292-8491-021557da0472 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:06.968299 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-767ce177-5cab-4742-9458-a64b8ed2c2a3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:06.968931 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-767ce177-5cab-4742-9458-a64b8ed2c2a3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:06.975661 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-767ce177-5cab-4742-9458-a64b8ed2c2a3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:06.977014 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-767ce177-5cab-4742-9458-a64b8ed2c2a3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:06.977798 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-767ce177-5cab-4742-9458-a64b8ed2c2a3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:06.978236 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-767ce177-5cab-4742-9458-a64b8ed2c2a3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:07.122186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a85946a7-5bb8-4292-8491-021557da0472 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:07.130371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a85946a7-5bb8-4292-8491-021557da0472 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.178920 May 18 17:07:07.131011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-767ce177-5cab-4742-9458-a64b8ed2c2a3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:07.133710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 95/199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:06 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:07.140025 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-767ce177-5cab-4742-9458-a64b8ed2c2a3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.176538 May 18 17:07:07.140598 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 105/200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:06 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:07.613930 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e03d7df8-842b-4d1b-8085-0f132c8ddc94 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:07.614538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e03d7df8-842b-4d1b-8085-0f132c8ddc94 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:07.621732 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e03d7df8-842b-4d1b-8085-0f132c8ddc94 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:07.622133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e03d7df8-842b-4d1b-8085-0f132c8ddc94 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:07.622915 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e03d7df8-842b-4d1b-8085-0f132c8ddc94 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:07.623352 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e03d7df8-842b-4d1b-8085-0f132c8ddc94 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:07.718235 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e03d7df8-842b-4d1b-8085-0f132c8ddc94 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:07.726656 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e03d7df8-842b-4d1b-8085-0f132c8ddc94 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1273 microversion: 2.1 time: 0.116525 May 18 17:07:07.727338 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 96/201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:07 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1273 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:07.918787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cb1b262a-f2e5-4f70-8a2e-d88e4e223433 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:07.920692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cb1b262a-f2e5-4f70-8a2e-d88e4e223433 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:07.923055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:07.929975 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cb1b262a-f2e5-4f70-8a2e-d88e4e223433 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:07.930728 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cb1b262a-f2e5-4f70-8a2e-d88e4e223433 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:07.931831 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cb1b262a-f2e5-4f70-8a2e-d88e4e223433 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:07.946846 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cb1b262a-f2e5-4f70-8a2e-d88e4e223433 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:08.004380 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=8 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:08.110531 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cb1b262a-f2e5-4f70-8a2e-d88e4e223433 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:08.117888 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cb1b262a-f2e5-4f70-8a2e-d88e4e223433 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.202964 May 18 17:07:08.118455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 106/202] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:07 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:08.148274 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cee421f2-d216-4844-bbb4-f47aa5a181dd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:08.148875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cee421f2-d216-4844-bbb4-f47aa5a181dd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:08.156460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2b670f00-d80f-4fe0-a3ae-3b94e4bd5a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:08.156734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cee421f2-d216-4844-bbb4-f47aa5a181dd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:08.157225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2b670f00-d80f-4fe0-a3ae-3b94e4bd5a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:08.157381 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cee421f2-d216-4844-bbb4-f47aa5a181dd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:08.158338 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cee421f2-d216-4844-bbb4-f47aa5a181dd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:08.158918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cee421f2-d216-4844-bbb4-f47aa5a181dd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:08.166682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b670f00-d80f-4fe0-a3ae-3b94e4bd5a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:08.167193 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b670f00-d80f-4fe0-a3ae-3b94e4bd5a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:08.167984 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b670f00-d80f-4fe0-a3ae-3b94e4bd5a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:08.168425 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2b670f00-d80f-4fe0-a3ae-3b94e4bd5a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:08.337109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2b670f00-d80f-4fe0-a3ae-3b94e4bd5a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:08.345799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2b670f00-d80f-4fe0-a3ae-3b94e4bd5a48 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.193369 May 18 17:07:08.346376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 107/203] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:08 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:08.385376 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cee421f2-d216-4844-bbb4-f47aa5a181dd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:08.393589 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cee421f2-d216-4844-bbb4-f47aa5a181dd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.249011 May 18 17:07:08.394199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 97/204] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:08 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:08.744258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-387b290c-09b3-405e-ac06-d186c5da0ddb tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:08.744707 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-387b290c-09b3-405e-ac06-d186c5da0ddb tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:08.751610 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-387b290c-09b3-405e-ac06-d186c5da0ddb tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:08.752314 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-387b290c-09b3-405e-ac06-d186c5da0ddb tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:08.753077 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-387b290c-09b3-405e-ac06-d186c5da0ddb tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:08.753508 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-387b290c-09b3-405e-ac06-d186c5da0ddb tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:08.822486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-387b290c-09b3-405e-ac06-d186c5da0ddb tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:08.831032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-387b290c-09b3-405e-ac06-d186c5da0ddb tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1273 microversion: 2.1 time: 0.090662 May 18 17:07:08.831607 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 108/205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:08 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:09.135100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-457df090-a5f8-4e7e-bb30-07909a63aab6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:09.136382 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-457df090-a5f8-4e7e-bb30-07909a63aab6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:09.142855 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-457df090-a5f8-4e7e-bb30-07909a63aab6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.143300 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-457df090-a5f8-4e7e-bb30-07909a63aab6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:09.144063 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-457df090-a5f8-4e7e-bb30-07909a63aab6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.144495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-457df090-a5f8-4e7e-bb30-07909a63aab6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:09.366458 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cbbc8d27-48aa-444c-a3d2-32c8d2e326cd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:09.367868 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cbbc8d27-48aa-444c-a3d2-32c8d2e326cd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:09.376930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbbc8d27-48aa-444c-a3d2-32c8d2e326cd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.377849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbbc8d27-48aa-444c-a3d2-32c8d2e326cd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:09.378924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbbc8d27-48aa-444c-a3d2-32c8d2e326cd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.380344 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbbc8d27-48aa-444c-a3d2-32c8d2e326cd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:09.394419 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-457df090-a5f8-4e7e-bb30-07909a63aab6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:09.408038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-457df090-a5f8-4e7e-bb30-07909a63aab6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1367 microversion: 2.1 time: 0.276577 May 18 17:07:09.408868 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 98/206] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:09 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:09.414866 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ea01ad68-a4c5-4ea2-ba37-36bde5de0abd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:09.417324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ea01ad68-a4c5-4ea2-ba37-36bde5de0abd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:09.432260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ea01ad68-a4c5-4ea2-ba37-36bde5de0abd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.434091 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ea01ad68-a4c5-4ea2-ba37-36bde5de0abd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:09.435148 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ea01ad68-a4c5-4ea2-ba37-36bde5de0abd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.435884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ea01ad68-a4c5-4ea2-ba37-36bde5de0abd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:09.787489 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cbbc8d27-48aa-444c-a3d2-32c8d2e326cd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:09.796588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cbbc8d27-48aa-444c-a3d2-32c8d2e326cd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.435312 May 18 17:07:09.806698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 109/207] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:09 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:09.812597 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-e1d3d24e-a8e1-4f27-b80f-d2423f6517d6 req-b90bbe82-35c9-42c2-8e87-a518ac9cdd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457f8f5f-ff7d-4484-8e29-298c7ecbee76", "name": "network-vif-plugged", "status": "completed", "tag": "574aa010-2b32-4402-9aca-f06181af0dc4"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:09.821423 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e1d3d24e-a8e1-4f27-b80f-d2423f6517d6 req-b90bbe82-35c9-42c2-8e87-a518ac9cdd6c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.821993 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e1d3d24e-a8e1-4f27-b80f-d2423f6517d6 req-b90bbe82-35c9-42c2-8e87-a518ac9cdd6c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:09.827155 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:09.835928 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-e1d3d24e-a8e1-4f27-b80f-d2423f6517d6 req-b90bbe82-35c9-42c2-8e87-a518ac9cdd6c service nova] Creating event network-vif-plugged:574aa010-2b32-4402-9aca-f06181af0dc4 for instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 on hv-cinder-79578 May 18 17:07:09.842573 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-e1d3d24e-a8e1-4f27-b80f-d2423f6517d6 req-b90bbe82-35c9-42c2-8e87-a518ac9cdd6c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033496 May 18 17:07:09.843276 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 110/208] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:09.847227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ea01ad68-a4c5-4ea2-ba37-36bde5de0abd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:09.853310 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-793d3670-9cb1-49b7-90b2-b0e5c539fd60 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:09.854041 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-793d3670-9cb1-49b7-90b2-b0e5c539fd60 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:09.856846 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ea01ad68-a4c5-4ea2-ba37-36bde5de0abd tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.446288 May 18 17:07:09.857610 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 99/209] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:09 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:09.866486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-793d3670-9cb1-49b7-90b2-b0e5c539fd60 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.866486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-793d3670-9cb1-49b7-90b2-b0e5c539fd60 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:09.866486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-793d3670-9cb1-49b7-90b2-b0e5c539fd60 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:09.866486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-793d3670-9cb1-49b7-90b2-b0e5c539fd60 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.025864 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-793d3670-9cb1-49b7-90b2-b0e5c539fd60 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:10.040127 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-793d3670-9cb1-49b7-90b2-b0e5c539fd60 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.190266 May 18 17:07:10.040945 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 111/210] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:09 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:10.430357 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-86e9b67f-fea4-41b8-aeee-3bc5866dc19d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:10.431625 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-86e9b67f-fea4-41b8-aeee-3bc5866dc19d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:10.439038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-86e9b67f-fea4-41b8-aeee-3bc5866dc19d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.439500 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-86e9b67f-fea4-41b8-aeee-3bc5866dc19d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.440280 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-86e9b67f-fea4-41b8-aeee-3bc5866dc19d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.440721 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-86e9b67f-fea4-41b8-aeee-3bc5866dc19d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.579877 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-9134f9aa-42d4-4376-9961-892d2bfce356 req-4133159f-2c5a-4907-b0bd-ed9b388e9625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12f7d8ea-adc0-42f8-809d-a5bacd802e68", "tag": "bc4bae2b-9934-4607-a66c-62d32d0d00d2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:10.600067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-9134f9aa-42d4-4376-9961-892d2bfce356 req-4133159f-2c5a-4907-b0bd-ed9b388e9625 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.603534 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-9134f9aa-42d4-4376-9961-892d2bfce356 req-4133159f-2c5a-4907-b0bd-ed9b388e9625 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.640929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-9134f9aa-42d4-4376-9961-892d2bfce356 req-4133159f-2c5a-4907-b0bd-ed9b388e9625 service nova] Creating event network-changed:bc4bae2b-9934-4607-a66c-62d32d0d00d2 for instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 on hv-cinder-79578 May 18 17:07:10.646743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-9134f9aa-42d4-4376-9961-892d2bfce356 req-4133159f-2c5a-4907-b0bd-ed9b388e9625 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073285 May 18 17:07:10.648578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 112/211] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:10.755312 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-86e9b67f-fea4-41b8-aeee-3bc5866dc19d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:10.766086 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-86e9b67f-fea4-41b8-aeee-3bc5866dc19d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1556 microversion: 2.1 time: 0.339328 May 18 17:07:10.775619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 100/212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:10 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1556 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:10.785093 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fb6533fd-54a4-4fdf-9000-302604ce045e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:10.786030 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fb6533fd-54a4-4fdf-9000-302604ce045e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:10.793640 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb6533fd-54a4-4fdf-9000-302604ce045e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.794526 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb6533fd-54a4-4fdf-9000-302604ce045e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.795976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb6533fd-54a4-4fdf-9000-302604ce045e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.796866 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb6533fd-54a4-4fdf-9000-302604ce045e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.817790 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3eff7b03-4930-4aed-b906-78497b465688 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:10.818502 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3eff7b03-4930-4aed-b906-78497b465688 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:10.824993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3eff7b03-4930-4aed-b906-78497b465688 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.825732 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3eff7b03-4930-4aed-b906-78497b465688 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.826743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3eff7b03-4930-4aed-b906-78497b465688 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.827958 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3eff7b03-4930-4aed-b906-78497b465688 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.905320 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fb6533fd-54a4-4fdf-9000-302604ce045e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124375 May 18 17:07:10.906211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 113/213] 10.222.0.49 () {58 vars in 1274 bytes} [Wed May 18 17:07:10 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:10.911852 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fde306ec-2933-4ac1-94e9-57b030ccaace tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:10.912821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fde306ec-2933-4ac1-94e9-57b030ccaace tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:10.922522 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fde306ec-2933-4ac1-94e9-57b030ccaace tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.923248 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fde306ec-2933-4ac1-94e9-57b030ccaace tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:10.924163 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fde306ec-2933-4ac1-94e9-57b030ccaace tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:10.924818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fde306ec-2933-4ac1-94e9-57b030ccaace tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:11.124076 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3eff7b03-4930-4aed-b906-78497b465688 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:11.133153 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3eff7b03-4930-4aed-b906-78497b465688 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.322050 May 18 17:07:11.134101 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 101/214] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:10 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:11.139630 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4ed32132-983b-4ee5-8d43-d061a4281eaa tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:11.140230 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4ed32132-983b-4ee5-8d43-d061a4281eaa tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:11.146570 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed32132-983b-4ee5-8d43-d061a4281eaa tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:11.147199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed32132-983b-4ee5-8d43-d061a4281eaa tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:11.148109 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed32132-983b-4ee5-8d43-d061a4281eaa tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:11.148736 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed32132-983b-4ee5-8d43-d061a4281eaa tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:11.322861 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ed32132-983b-4ee5-8d43-d061a4281eaa tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:11.331200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4ed32132-983b-4ee5-8d43-d061a4281eaa tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.195887 May 18 17:07:11.332821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fde306ec-2933-4ac1-94e9-57b030ccaace tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:11.338185 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 102/215] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:11 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:11.345054 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fde306ec-2933-4ac1-94e9-57b030ccaace tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.437427 May 18 17:07:11.345641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 114/216] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:10 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:12.152383 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c6629809-829a-4fe7-83e2-62a2161e0475 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:12.152992 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c6629809-829a-4fe7-83e2-62a2161e0475 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:12.160015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c6629809-829a-4fe7-83e2-62a2161e0475 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:12.160754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c6629809-829a-4fe7-83e2-62a2161e0475 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:12.161718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c6629809-829a-4fe7-83e2-62a2161e0475 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:12.162381 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c6629809-829a-4fe7-83e2-62a2161e0475 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:12.336641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c6629809-829a-4fe7-83e2-62a2161e0475 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:12.348319 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d6f80a4e-e80d-479d-a940-88575804439d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:12.349331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d6f80a4e-e80d-479d-a940-88575804439d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:12.370548 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6f80a4e-e80d-479d-a940-88575804439d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:12.374473 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6f80a4e-e80d-479d-a940-88575804439d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:12.375235 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6f80a4e-e80d-479d-a940-88575804439d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:12.375683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d6f80a4e-e80d-479d-a940-88575804439d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:12.377487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c6629809-829a-4fe7-83e2-62a2161e0475 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.216886 May 18 17:07:12.378264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 103/217] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:12 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:12.384035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b4509ca2-6116-4ec4-bb55-5b940f8db310 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:12.386202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b4509ca2-6116-4ec4-bb55-5b940f8db310 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:12.393018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4509ca2-6116-4ec4-bb55-5b940f8db310 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:12.395435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4509ca2-6116-4ec4-bb55-5b940f8db310 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:12.396644 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4509ca2-6116-4ec4-bb55-5b940f8db310 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:12.397145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4509ca2-6116-4ec4-bb55-5b940f8db310 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:12.575989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4509ca2-6116-4ec4-bb55-5b940f8db310 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:12.586426 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b4509ca2-6116-4ec4-bb55-5b940f8db310 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1362 microversion: 2.1 time: 0.206721 May 18 17:07:12.598001 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 104/218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:12 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:12.777616 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d6f80a4e-e80d-479d-a940-88575804439d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:12.789719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d6f80a4e-e80d-479d-a940-88575804439d tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.445132 May 18 17:07:12.790272 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 115/219] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:12 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:12.792293 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-0c94c277-7a5f-4cab-8c8d-01b786606a3a req-e208e40a-291c-401f-85dc-bc9497865527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76ee8046-a947-4f1c-badc-cdf4a50fcd6e", "tag": "68dda7a1-bf2e-4af2-b271-828eec9d063b"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:12.809994 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-0c94c277-7a5f-4cab-8c8d-01b786606a3a req-e208e40a-291c-401f-85dc-bc9497865527 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:12.810829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-0c94c277-7a5f-4cab-8c8d-01b786606a3a req-e208e40a-291c-401f-85dc-bc9497865527 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:12.850788 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-0c94c277-7a5f-4cab-8c8d-01b786606a3a req-e208e40a-291c-401f-85dc-bc9497865527 service nova] Creating event network-changed:68dda7a1-bf2e-4af2-b271-828eec9d063b for instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e on hv-cinder-79578 May 18 17:07:12.868662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-0c94c277-7a5f-4cab-8c8d-01b786606a3a req-e208e40a-291c-401f-85dc-bc9497865527 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081334 May 18 17:07:12.869289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 105/220] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:13.401066 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-16be50ba-2f53-4731-ad44-c91e4c48059d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:13.405474 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-16be50ba-2f53-4731-ad44-c91e4c48059d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:13.424511 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16be50ba-2f53-4731-ad44-c91e4c48059d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:13.426088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16be50ba-2f53-4731-ad44-c91e4c48059d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:13.429900 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16be50ba-2f53-4731-ad44-c91e4c48059d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:13.433465 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16be50ba-2f53-4731-ad44-c91e4c48059d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:13.606153 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-44f99836-75c7-4dab-bb27-e0c26c7c1278 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:13.607149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-44f99836-75c7-4dab-bb27-e0c26c7c1278 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:13.622130 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44f99836-75c7-4dab-bb27-e0c26c7c1278 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:13.624940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44f99836-75c7-4dab-bb27-e0c26c7c1278 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:13.627600 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44f99836-75c7-4dab-bb27-e0c26c7c1278 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:13.630331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44f99836-75c7-4dab-bb27-e0c26c7c1278 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:13.651185 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-16be50ba-2f53-4731-ad44-c91e4c48059d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:13.665183 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-16be50ba-2f53-4731-ad44-c91e4c48059d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.272372 May 18 17:07:13.669503 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 116/221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:13 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:13.809334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fc1c62c1-e685-4674-b3eb-43cdda44842a tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:13.810290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fc1c62c1-e685-4674-b3eb-43cdda44842a tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:13.818051 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fc1c62c1-e685-4674-b3eb-43cdda44842a tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:13.818646 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fc1c62c1-e685-4674-b3eb-43cdda44842a tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:13.819499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fc1c62c1-e685-4674-b3eb-43cdda44842a tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:13.820210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fc1c62c1-e685-4674-b3eb-43cdda44842a tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:13.865359 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44f99836-75c7-4dab-bb27-e0c26c7c1278 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:13.880626 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-44f99836-75c7-4dab-bb27-e0c26c7c1278 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1548 microversion: 2.1 time: 0.278985 May 18 17:07:13.881494 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 106/222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:13 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1548 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:13.899554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c5a88ae3-da83-463f-ab1c-c4797e52c729 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:13.900332 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c5a88ae3-da83-463f-ab1c-c4797e52c729 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:13.909818 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c5a88ae3-da83-463f-ab1c-c4797e52c729 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:13.910650 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c5a88ae3-da83-463f-ab1c-c4797e52c729 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:13.911636 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c5a88ae3-da83-463f-ab1c-c4797e52c729 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:13.912282 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c5a88ae3-da83-463f-ab1c-c4797e52c729 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:14.129243 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c5a88ae3-da83-463f-ab1c-c4797e52c729 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.233502 May 18 17:07:14.134135 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 107/223] 10.222.0.49 () {58 vars in 1274 bytes} [Wed May 18 17:07:13 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/os-interface => generated 284 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:07:14.139377 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fc1c62c1-e685-4674-b3eb-43cdda44842a tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:14.151180 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fc1c62c1-e685-4674-b3eb-43cdda44842a tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.346911 May 18 17:07:14.154778 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 117/224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:13 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:14.690615 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c2d0120a-ef9a-4d9f-8266-ea192698afa6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:14.691284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c2d0120a-ef9a-4d9f-8266-ea192698afa6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:14.699722 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c2d0120a-ef9a-4d9f-8266-ea192698afa6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:14.700799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c2d0120a-ef9a-4d9f-8266-ea192698afa6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:14.701598 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c2d0120a-ef9a-4d9f-8266-ea192698afa6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:14.702593 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c2d0120a-ef9a-4d9f-8266-ea192698afa6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:15.172517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d64ed485-72ff-4973-8722-3c77c8d64ca9 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:15.173835 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d64ed485-72ff-4973-8722-3c77c8d64ca9 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:15.182013 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d64ed485-72ff-4973-8722-3c77c8d64ca9 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:15.184157 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d64ed485-72ff-4973-8722-3c77c8d64ca9 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:15.185289 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d64ed485-72ff-4973-8722-3c77c8d64ca9 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:15.185986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d64ed485-72ff-4973-8722-3c77c8d64ca9 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:15.378206 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d64ed485-72ff-4973-8722-3c77c8d64ca9 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:15.393081 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d64ed485-72ff-4973-8722-3c77c8d64ca9 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.227072 May 18 17:07:15.404806 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 118/225] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:15 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:15.429534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c2d0120a-ef9a-4d9f-8266-ea192698afa6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:15.438402 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c2d0120a-ef9a-4d9f-8266-ea192698afa6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.752485 May 18 17:07:15.439703 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 108/226] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:14 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:15.891883 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-ef950b04-c0cd-4f57-bfaf-dc3cf0109b88 req-cd015599-c0e3-4fb0-8f44-351b37b5b5b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "457f8f5f-ff7d-4484-8e29-298c7ecbee76", "tag": "574aa010-2b32-4402-9aca-f06181af0dc4"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:15.911486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ef950b04-c0cd-4f57-bfaf-dc3cf0109b88 req-cd015599-c0e3-4fb0-8f44-351b37b5b5b7 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:15.912292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ef950b04-c0cd-4f57-bfaf-dc3cf0109b88 req-cd015599-c0e3-4fb0-8f44-351b37b5b5b7 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:15.926195 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-ef950b04-c0cd-4f57-bfaf-dc3cf0109b88 req-cd015599-c0e3-4fb0-8f44-351b37b5b5b7 service nova] Creating event network-changed:574aa010-2b32-4402-9aca-f06181af0dc4 for instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 on hv-cinder-79578 May 18 17:07:15.931913 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-ef950b04-c0cd-4f57-bfaf-dc3cf0109b88 req-cd015599-c0e3-4fb0-8f44-351b37b5b5b7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043825 May 18 17:07:15.932567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 119/227] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:16.412799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9f2a616c-0b4f-46d6-9488-33c9f94c3ba3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:16.415144 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9f2a616c-0b4f-46d6-9488-33c9f94c3ba3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:16.425794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f2a616c-0b4f-46d6-9488-33c9f94c3ba3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:16.426492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f2a616c-0b4f-46d6-9488-33c9f94c3ba3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:16.427551 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f2a616c-0b4f-46d6-9488-33c9f94c3ba3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:16.428141 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f2a616c-0b4f-46d6-9488-33c9f94c3ba3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:16.433800 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:16.457199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-06291048-f01d-4041-a667-661b5f106e45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:16.458125 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-06291048-f01d-4041-a667-661b5f106e45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:16.486263 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-06291048-f01d-4041-a667-661b5f106e45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:16.486651 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-06291048-f01d-4041-a667-661b5f106e45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:16.490159 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-06291048-f01d-4041-a667-661b5f106e45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:16.490921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-06291048-f01d-4041-a667-661b5f106e45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:16.650819 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9f2a616c-0b4f-46d6-9488-33c9f94c3ba3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:16.664200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9f2a616c-0b4f-46d6-9488-33c9f94c3ba3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.254501 May 18 17:07:16.664919 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 109/228] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:16 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:16.710402 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-06291048-f01d-4041-a667-661b5f106e45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:16.723747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-06291048-f01d-4041-a667-661b5f106e45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.271940 May 18 17:07:16.724841 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 120/229] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:16 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:17.681796 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2668040d-d035-4138-ba26-4d2556fcdfb3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:17.682444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2668040d-d035-4138-ba26-4d2556fcdfb3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:17.685804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=74 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:17.689943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2668040d-d035-4138-ba26-4d2556fcdfb3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:17.690392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2668040d-d035-4138-ba26-4d2556fcdfb3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:17.691156 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2668040d-d035-4138-ba26-4d2556fcdfb3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:17.691585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2668040d-d035-4138-ba26-4d2556fcdfb3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:17.741588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3b175302-fbec-40cb-9e3b-88d7f17d24d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:17.742410 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3b175302-fbec-40cb-9e3b-88d7f17d24d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:17.755330 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b175302-fbec-40cb-9e3b-88d7f17d24d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:17.755957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b175302-fbec-40cb-9e3b-88d7f17d24d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:17.757091 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b175302-fbec-40cb-9e3b-88d7f17d24d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:17.759668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b175302-fbec-40cb-9e3b-88d7f17d24d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:17.917309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3b175302-fbec-40cb-9e3b-88d7f17d24d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:17.925490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3b175302-fbec-40cb-9e3b-88d7f17d24d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.187914 May 18 17:07:17.927219 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 121/230] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:17 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:17.986349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2668040d-d035-4138-ba26-4d2556fcdfb3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:17.993755 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2668040d-d035-4138-ba26-4d2556fcdfb3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.315611 May 18 17:07:17.994320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 110/231] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:17 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:18.944361 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f585f13d-21d2-42d7-9d6e-d179d990a6ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:18.945048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f585f13d-21d2-42d7-9d6e-d179d990a6ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:18.952356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f585f13d-21d2-42d7-9d6e-d179d990a6ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:18.952823 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f585f13d-21d2-42d7-9d6e-d179d990a6ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:18.953938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f585f13d-21d2-42d7-9d6e-d179d990a6ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:18.954058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f585f13d-21d2-42d7-9d6e-d179d990a6ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:19.013074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2cfaf2ae-b47e-48ec-b857-9635a2185896 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:19.013859 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2cfaf2ae-b47e-48ec-b857-9635a2185896 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:19.027781 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2cfaf2ae-b47e-48ec-b857-9635a2185896 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:19.031102 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2cfaf2ae-b47e-48ec-b857-9635a2185896 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:19.032043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2cfaf2ae-b47e-48ec-b857-9635a2185896 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:19.032404 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2cfaf2ae-b47e-48ec-b857-9635a2185896 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:19.157849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f585f13d-21d2-42d7-9d6e-d179d990a6ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:19.165927 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f585f13d-21d2-42d7-9d6e-d179d990a6ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.225466 May 18 17:07:19.167682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 122/232] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:18 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:19.195349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2cfaf2ae-b47e-48ec-b857-9635a2185896 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:19.204533 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2cfaf2ae-b47e-48ec-b857-9635a2185896 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.198105 May 18 17:07:19.205097 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 111/233] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:19 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:20.184420 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0f6a225b-9a7e-451a-85f3-53f54fff5b06 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:20.185039 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0f6a225b-9a7e-451a-85f3-53f54fff5b06 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:20.191237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f6a225b-9a7e-451a-85f3-53f54fff5b06 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:20.191692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f6a225b-9a7e-451a-85f3-53f54fff5b06 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:20.192460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f6a225b-9a7e-451a-85f3-53f54fff5b06 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:20.192897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0f6a225b-9a7e-451a-85f3-53f54fff5b06 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:20.220976 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c7fa6343-82ee-4cbb-b9c3-5db02bed09b0 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:20.221583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c7fa6343-82ee-4cbb-b9c3-5db02bed09b0 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:20.228616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7fa6343-82ee-4cbb-b9c3-5db02bed09b0 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:20.229066 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7fa6343-82ee-4cbb-b9c3-5db02bed09b0 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:20.229875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7fa6343-82ee-4cbb-b9c3-5db02bed09b0 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:20.230431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7fa6343-82ee-4cbb-b9c3-5db02bed09b0 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:20.342890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0f6a225b-9a7e-451a-85f3-53f54fff5b06 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:20.352516 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0f6a225b-9a7e-451a-85f3-53f54fff5b06 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.172416 May 18 17:07:20.353456 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 123/234] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:20 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:20.378202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c7fa6343-82ee-4cbb-b9c3-5db02bed09b0 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:20.386119 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c7fa6343-82ee-4cbb-b9c3-5db02bed09b0 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.168413 May 18 17:07:20.386690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 112/235] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:20 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:21.370775 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bf9cb554-e1a2-4eb1-a7ac-fc8821be2f0a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:21.371389 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bf9cb554-e1a2-4eb1-a7ac-fc8821be2f0a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:21.377646 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf9cb554-e1a2-4eb1-a7ac-fc8821be2f0a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.378126 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf9cb554-e1a2-4eb1-a7ac-fc8821be2f0a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.378894 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf9cb554-e1a2-4eb1-a7ac-fc8821be2f0a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.379329 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf9cb554-e1a2-4eb1-a7ac-fc8821be2f0a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.403308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-21de0685-231b-42ea-b640-8fd03ae4b636 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:21.404063 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-21de0685-231b-42ea-b640-8fd03ae4b636 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:21.410858 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-21de0685-231b-42ea-b640-8fd03ae4b636 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.411309 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-21de0685-231b-42ea-b640-8fd03ae4b636 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.412073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-21de0685-231b-42ea-b640-8fd03ae4b636 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.412507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-21de0685-231b-42ea-b640-8fd03ae4b636 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.532386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bf9cb554-e1a2-4eb1-a7ac-fc8821be2f0a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:21.540013 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bf9cb554-e1a2-4eb1-a7ac-fc8821be2f0a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.173992 May 18 17:07:21.540588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 124/236] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:21 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:21.566690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-21de0685-231b-42ea-b640-8fd03ae4b636 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:21.574339 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-21de0685-231b-42ea-b640-8fd03ae4b636 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.175372 May 18 17:07:21.574904 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 113/237] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:21 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:21.597807 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-273d9803-c8fa-460d-89f9-c2560d337fc1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:21.598297 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-273d9803-c8fa-460d-89f9-c2560d337fc1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:21.605250 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-273d9803-c8fa-460d-89f9-c2560d337fc1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.605715 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-273d9803-c8fa-460d-89f9-c2560d337fc1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.606478 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-273d9803-c8fa-460d-89f9-c2560d337fc1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.606935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-273d9803-c8fa-460d-89f9-c2560d337fc1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.633403 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-273d9803-c8fa-460d-89f9-c2560d337fc1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:07:21.746288 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-273d9803-c8fa-460d-89f9-c2560d337fc1 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 204 len: 0 microversion: 2.1 time: 0.150606 May 18 17:07:21.746909 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 125/238] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:07:21 2022] DELETE /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:07:21.755393 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-293be6b1-e1b5-4266-993f-25dd63cd54bf tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:21.756364 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-293be6b1-e1b5-4266-993f-25dd63cd54bf tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:21.770469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-293be6b1-e1b5-4266-993f-25dd63cd54bf tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.771401 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-293be6b1-e1b5-4266-993f-25dd63cd54bf tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.772206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-293be6b1-e1b5-4266-993f-25dd63cd54bf tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.772647 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-293be6b1-e1b5-4266-993f-25dd63cd54bf tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.797792 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-a9778c76-82fe-4a38-a692-4b917dd5b7eb req-ac9339f4-ba99-484b-9e69-1a86b5cf8601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12f7d8ea-adc0-42f8-809d-a5bacd802e68", "name": "network-vif-plugged", "status": "completed", "tag": "bc4bae2b-9934-4607-a66c-62d32d0d00d2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:21.811709 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a9778c76-82fe-4a38-a692-4b917dd5b7eb req-ac9339f4-ba99-484b-9e69-1a86b5cf8601 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:21.812468 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a9778c76-82fe-4a38-a692-4b917dd5b7eb req-ac9339f4-ba99-484b-9e69-1a86b5cf8601 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:21.828054 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-a9778c76-82fe-4a38-a692-4b917dd5b7eb req-ac9339f4-ba99-484b-9e69-1a86b5cf8601 service nova] Creating event network-vif-plugged:bc4bae2b-9934-4607-a66c-62d32d0d00d2 for instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 on hv-cinder-79578 May 18 17:07:21.836955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-a9778c76-82fe-4a38-a692-4b917dd5b7eb req-ac9339f4-ba99-484b-9e69-1a86b5cf8601 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048381 May 18 17:07:21.836955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 126/239] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:07:21.936335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-293be6b1-e1b5-4266-993f-25dd63cd54bf tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:21.945301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-293be6b1-e1b5-4266-993f-25dd63cd54bf tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1553 microversion: 2.1 time: 0.193664 May 18 17:07:21.946044 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 114/240] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:21 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1553 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:22.558888 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0a9d596c-a983-425a-ac3c-23831956a5da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:22.560623 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0a9d596c-a983-425a-ac3c-23831956a5da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:22.566400 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0a9d596c-a983-425a-ac3c-23831956a5da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:22.566862 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0a9d596c-a983-425a-ac3c-23831956a5da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:22.567638 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0a9d596c-a983-425a-ac3c-23831956a5da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:22.568109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0a9d596c-a983-425a-ac3c-23831956a5da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:22.592289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4acbdc5e-06e4-4aa0-ae2a-3c8fe6a55db8 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:22.592988 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4acbdc5e-06e4-4aa0-ae2a-3c8fe6a55db8 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:22.600207 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4acbdc5e-06e4-4aa0-ae2a-3c8fe6a55db8 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:22.600658 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4acbdc5e-06e4-4aa0-ae2a-3c8fe6a55db8 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:22.601416 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4acbdc5e-06e4-4aa0-ae2a-3c8fe6a55db8 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:22.601879 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4acbdc5e-06e4-4aa0-ae2a-3c8fe6a55db8 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:22.726137 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0a9d596c-a983-425a-ac3c-23831956a5da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:22.738507 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0a9d596c-a983-425a-ac3c-23831956a5da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.184351 May 18 17:07:22.739095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 127/241] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:22 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:22.741940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4acbdc5e-06e4-4aa0-ae2a-3c8fe6a55db8 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:22.751860 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4acbdc5e-06e4-4aa0-ae2a-3c8fe6a55db8 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.164416 May 18 17:07:22.752460 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 115/242] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:22 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:22.963113 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5fececf4-263b-44d4-a084-33b75ea2a450 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:22.964107 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5fececf4-263b-44d4-a084-33b75ea2a450 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:22.970260 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fececf4-263b-44d4-a084-33b75ea2a450 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:22.970705 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fececf4-263b-44d4-a084-33b75ea2a450 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:22.971477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fececf4-263b-44d4-a084-33b75ea2a450 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:22.971922 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fececf4-263b-44d4-a084-33b75ea2a450 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:22.974606 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:23.122369 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5fececf4-263b-44d4-a084-33b75ea2a450 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:23.133090 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5fececf4-263b-44d4-a084-33b75ea2a450 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1553 microversion: 2.1 time: 0.173748 May 18 17:07:23.138641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 128/243] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:22 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:23.755465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2335c705-7f14-4e30-834a-44068eff5f55 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:23.756036 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2335c705-7f14-4e30-834a-44068eff5f55 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:23.763306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2335c705-7f14-4e30-834a-44068eff5f55 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:23.763759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2335c705-7f14-4e30-834a-44068eff5f55 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:23.764647 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2335c705-7f14-4e30-834a-44068eff5f55 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:23.765123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2335c705-7f14-4e30-834a-44068eff5f55 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:23.770274 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cfd8a9a4-0749-40ef-9192-d55322b05107 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:23.771339 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cfd8a9a4-0749-40ef-9192-d55322b05107 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:23.779081 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfd8a9a4-0749-40ef-9192-d55322b05107 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:23.779481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfd8a9a4-0749-40ef-9192-d55322b05107 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:23.780247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfd8a9a4-0749-40ef-9192-d55322b05107 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:23.780753 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfd8a9a4-0749-40ef-9192-d55322b05107 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:23.901606 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2335c705-7f14-4e30-834a-44068eff5f55 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:23.909352 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2335c705-7f14-4e30-834a-44068eff5f55 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.157916 May 18 17:07:23.909963 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 116/244] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:23 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:23.916714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cfd8a9a4-0749-40ef-9192-d55322b05107 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:23.924108 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cfd8a9a4-0749-40ef-9192-d55322b05107 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.158106 May 18 17:07:23.924671 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 129/245] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:23 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:24.150284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8ad02ff4-e8fb-478f-a09f-8dfbcd26b2d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:24.150819 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8ad02ff4-e8fb-478f-a09f-8dfbcd26b2d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:24.157068 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ad02ff4-e8fb-478f-a09f-8dfbcd26b2d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:24.157514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ad02ff4-e8fb-478f-a09f-8dfbcd26b2d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:24.158327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ad02ff4-e8fb-478f-a09f-8dfbcd26b2d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:24.158761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ad02ff4-e8fb-478f-a09f-8dfbcd26b2d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:24.290978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8ad02ff4-e8fb-478f-a09f-8dfbcd26b2d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:24.299427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8ad02ff4-e8fb-478f-a09f-8dfbcd26b2d3 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1553 microversion: 2.1 time: 0.153099 May 18 17:07:24.299993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 117/246] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:24 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:24.926892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4b743d77-ccca-44ae-a41c-6c9d28871fb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:24.927537 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4b743d77-ccca-44ae-a41c-6c9d28871fb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:24.933721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4b743d77-ccca-44ae-a41c-6c9d28871fb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:24.934171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4b743d77-ccca-44ae-a41c-6c9d28871fb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:24.935762 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4b743d77-ccca-44ae-a41c-6c9d28871fb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:24.935762 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4b743d77-ccca-44ae-a41c-6c9d28871fb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:24.941232 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bbd47c54-cd09-4df4-8f4f-a69a32f297a4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:24.942105 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bbd47c54-cd09-4df4-8f4f-a69a32f297a4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:24.950339 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bbd47c54-cd09-4df4-8f4f-a69a32f297a4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:24.950936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bbd47c54-cd09-4df4-8f4f-a69a32f297a4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:24.951866 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bbd47c54-cd09-4df4-8f4f-a69a32f297a4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:24.952427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bbd47c54-cd09-4df4-8f4f-a69a32f297a4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:25.078625 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4b743d77-ccca-44ae-a41c-6c9d28871fb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:25.086368 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4b743d77-ccca-44ae-a41c-6c9d28871fb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.163961 May 18 17:07:25.087286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 130/247] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:24 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:25.159822 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bbd47c54-cd09-4df4-8f4f-a69a32f297a4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:25.168252 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bbd47c54-cd09-4df4-8f4f-a69a32f297a4 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.231009 May 18 17:07:25.168852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 118/248] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:24 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:25.317376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2629caed-79d1-49d7-a662-d8cf598e65ae tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:25.318233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2629caed-79d1-49d7-a662-d8cf598e65ae tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:25.325809 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2629caed-79d1-49d7-a662-d8cf598e65ae tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:25.326265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2629caed-79d1-49d7-a662-d8cf598e65ae tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:25.327061 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2629caed-79d1-49d7-a662-d8cf598e65ae tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:25.327634 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2629caed-79d1-49d7-a662-d8cf598e65ae tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:25.518092 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2629caed-79d1-49d7-a662-d8cf598e65ae tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:25.528032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2629caed-79d1-49d7-a662-d8cf598e65ae tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1553 microversion: 2.1 time: 0.214449 May 18 17:07:25.528625 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 131/249] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:25 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:26.104760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-20cdf195-a69a-442a-9b21-09b3d91e4d7e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:26.105940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-20cdf195-a69a-442a-9b21-09b3d91e4d7e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:26.112853 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-20cdf195-a69a-442a-9b21-09b3d91e4d7e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:26.113350 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-20cdf195-a69a-442a-9b21-09b3d91e4d7e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:26.114114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-20cdf195-a69a-442a-9b21-09b3d91e4d7e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:26.114554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-20cdf195-a69a-442a-9b21-09b3d91e4d7e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:26.186019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0dbd0a43-1429-45df-ae1d-9b84a3cdb2ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:26.186630 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0dbd0a43-1429-45df-ae1d-9b84a3cdb2ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:26.192752 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dbd0a43-1429-45df-ae1d-9b84a3cdb2ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:26.193193 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dbd0a43-1429-45df-ae1d-9b84a3cdb2ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:26.194149 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dbd0a43-1429-45df-ae1d-9b84a3cdb2ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:26.194580 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dbd0a43-1429-45df-ae1d-9b84a3cdb2ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:26.259418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-20cdf195-a69a-442a-9b21-09b3d91e4d7e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:26.269843 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-20cdf195-a69a-442a-9b21-09b3d91e4d7e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.169472 May 18 17:07:26.270450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 119/250] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:26 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:26.340232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0dbd0a43-1429-45df-ae1d-9b84a3cdb2ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:26.348347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0dbd0a43-1429-45df-ae1d-9b84a3cdb2ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1315 microversion: 2.1 time: 0.167773 May 18 17:07:26.349167 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 132/251] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:26 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:26.546043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-253b41c6-f4bb-4175-8c65-ab2f97091b61 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:26.546727 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-253b41c6-f4bb-4175-8c65-ab2f97091b61 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:26.553323 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-253b41c6-f4bb-4175-8c65-ab2f97091b61 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:26.554118 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-253b41c6-f4bb-4175-8c65-ab2f97091b61 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:26.554955 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-253b41c6-f4bb-4175-8c65-ab2f97091b61 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:26.555463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-253b41c6-f4bb-4175-8c65-ab2f97091b61 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:26.700624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-253b41c6-f4bb-4175-8c65-ab2f97091b61 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:26.709138 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-253b41c6-f4bb-4175-8c65-ab2f97091b61 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1553 microversion: 2.1 time: 0.167765 May 18 17:07:26.709951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 120/252] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:26 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:27.190761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-dca02ce1-d5e6-437a-9593-5a3178addcb5 req-368214d8-2d78-4bc6-974f-c4dfaaa6cf77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9803931-931f-4c10-92de-264b813d7d3c", "name": "network-vif-deleted", "tag": "9288fe21-bb66-4add-9ae5-bc39c25cdcb7"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:27.200150 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-dca02ce1-d5e6-437a-9593-5a3178addcb5 req-368214d8-2d78-4bc6-974f-c4dfaaa6cf77 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.200594 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-dca02ce1-d5e6-437a-9593-5a3178addcb5 req-368214d8-2d78-4bc6-974f-c4dfaaa6cf77 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.212207 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-dca02ce1-d5e6-437a-9593-5a3178addcb5 req-368214d8-2d78-4bc6-974f-c4dfaaa6cf77 service nova] Creating event network-vif-deleted:9288fe21-bb66-4add-9ae5-bc39c25cdcb7 for instance e9803931-931f-4c10-92de-264b813d7d3c on hv-cinder-79578 May 18 17:07:27.217930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-dca02ce1-d5e6-437a-9593-5a3178addcb5 req-368214d8-2d78-4bc6-974f-c4dfaaa6cf77 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 May 18 17:07:27.218529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 133/253] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:27.286657 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-646eca3c-10ac-456b-b7db-6c3ed2e0edf8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:27.287854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-646eca3c-10ac-456b-b7db-6c3ed2e0edf8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:27.294226 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-646eca3c-10ac-456b-b7db-6c3ed2e0edf8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.294674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-646eca3c-10ac-456b-b7db-6c3ed2e0edf8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.295443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-646eca3c-10ac-456b-b7db-6c3ed2e0edf8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.295874 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-646eca3c-10ac-456b-b7db-6c3ed2e0edf8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.376632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-87220be0-320a-4994-b80a-f012c97bd7b6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:27.377350 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-87220be0-320a-4994-b80a-f012c97bd7b6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:27.401843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87220be0-320a-4994-b80a-f012c97bd7b6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.402305 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87220be0-320a-4994-b80a-f012c97bd7b6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.403307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87220be0-320a-4994-b80a-f012c97bd7b6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.403913 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87220be0-320a-4994-b80a-f012c97bd7b6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.457280 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-646eca3c-10ac-456b-b7db-6c3ed2e0edf8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:27.467899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-646eca3c-10ac-456b-b7db-6c3ed2e0edf8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.185058 May 18 17:07:27.468582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 121/254] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:27 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:27.553926 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-87220be0-320a-4994-b80a-f012c97bd7b6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:27.561903 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-87220be0-320a-4994-b80a-f012c97bd7b6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1464 microversion: 2.1 time: 0.196392 May 18 17:07:27.562459 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 134/255] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:27 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1464 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:27.602270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3b0e3c4-2612-4559-bf53-38f5b63b96ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:27.602772 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d3b0e3c4-2612-4559-bf53-38f5b63b96ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:27.609118 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3b0e3c4-2612-4559-bf53-38f5b63b96ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.609586 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3b0e3c4-2612-4559-bf53-38f5b63b96ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.610405 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3b0e3c4-2612-4559-bf53-38f5b63b96ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.610920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3b0e3c4-2612-4559-bf53-38f5b63b96ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.643129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d3b0e3c4-2612-4559-bf53-38f5b63b96ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:07:27.736774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d3b0e3c4-2612-4559-bf53-38f5b63b96ea tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "DELETE /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 204 len: 0 microversion: 2.1 time: 0.137889 May 18 17:07:27.737037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e9d6f2f6-5bcb-4367-8937-6ae89fbd37f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:27.737460 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 122/256] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:07:27 2022] DELETE /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:07:27.740691 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e9d6f2f6-5bcb-4367-8937-6ae89fbd37f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:27.748175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-26e7993f-2144-4755-96df-739a401220f5 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:27.749114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-26e7993f-2144-4755-96df-739a401220f5 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:27.755709 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-26e7993f-2144-4755-96df-739a401220f5 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.755878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e9d6f2f6-5bcb-4367-8937-6ae89fbd37f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.756148 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-26e7993f-2144-4755-96df-739a401220f5 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.756805 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e9d6f2f6-5bcb-4367-8937-6ae89fbd37f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.757146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-26e7993f-2144-4755-96df-739a401220f5 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.757634 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-26e7993f-2144-4755-96df-739a401220f5 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.757782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e9d6f2f6-5bcb-4367-8937-6ae89fbd37f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:27.758109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e9d6f2f6-5bcb-4367-8937-6ae89fbd37f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:27.829585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e9d6f2f6-5bcb-4367-8937-6ae89fbd37f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:27.839407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e9d6f2f6-5bcb-4367-8937-6ae89fbd37f7 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1345 microversion: 2.1 time: 0.115408 May 18 17:07:27.839915 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 135/257] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:27 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:27.915074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-26e7993f-2144-4755-96df-739a401220f5 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:27.922708 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-26e7993f-2144-4755-96df-739a401220f5 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1470 microversion: 2.1 time: 0.180509 May 18 17:07:27.923301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 123/258] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:27 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:28.484820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ef4beb5b-79e3-43e4-aad7-164fa1d91b28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:28.485490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ef4beb5b-79e3-43e4-aad7-164fa1d91b28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:28.491481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ef4beb5b-79e3-43e4-aad7-164fa1d91b28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:28.491937 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ef4beb5b-79e3-43e4-aad7-164fa1d91b28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:28.492694 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ef4beb5b-79e3-43e4-aad7-164fa1d91b28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:28.493139 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ef4beb5b-79e3-43e4-aad7-164fa1d91b28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:28.629795 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ef4beb5b-79e3-43e4-aad7-164fa1d91b28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:28.640335 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ef4beb5b-79e3-43e4-aad7-164fa1d91b28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.159382 May 18 17:07:28.640926 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 136/259] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:28 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:28.857189 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:28.857920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:28.864335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:28.864787 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:28.865557 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:28.866029 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:28.868759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:28.903414 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:28.903860 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:28.904342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lazy-loading 'fault' on Instance uuid e9803931-931f-4c10-92de-264b813d7d3c {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:07:28.940158 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d2aa0100-84b9-4e49-950c-bb850fb55da6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:28.940767 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d2aa0100-84b9-4e49-950c-bb850fb55da6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:28.946848 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2aa0100-84b9-4e49-950c-bb850fb55da6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:28.947303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2aa0100-84b9-4e49-950c-bb850fb55da6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:28.948646 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2aa0100-84b9-4e49-950c-bb850fb55da6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:28.949088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2aa0100-84b9-4e49-950c-bb850fb55da6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:28.950031 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:28.959963 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4db1c47a-fa6e-4203-a848-76fa3438077d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1350 microversion: 2.1 time: 0.107301 May 18 17:07:28.960546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 124/260] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:28 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:29.080950 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d2aa0100-84b9-4e49-950c-bb850fb55da6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:29.088383 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d2aa0100-84b9-4e49-950c-bb850fb55da6 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1470 microversion: 2.1 time: 0.152223 May 18 17:07:29.089803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 137/261] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:28 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:29.658220 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e8ca4fd6-03d5-4b34-9192-8ec5028c0526 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:29.658834 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e8ca4fd6-03d5-4b34-9192-8ec5028c0526 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:29.665918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8ca4fd6-03d5-4b34-9192-8ec5028c0526 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:29.668043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8ca4fd6-03d5-4b34-9192-8ec5028c0526 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:29.668904 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8ca4fd6-03d5-4b34-9192-8ec5028c0526 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:29.669578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e8ca4fd6-03d5-4b34-9192-8ec5028c0526 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:29.864785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e8ca4fd6-03d5-4b34-9192-8ec5028c0526 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:29.874100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e8ca4fd6-03d5-4b34-9192-8ec5028c0526 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.219571 May 18 17:07:29.874687 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 125/262] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:29 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:29.979571 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:29.980667 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:29.987926 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:29.988378 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:29.989162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:29.989597 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:30.024986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:30.025649 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:30.026524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lazy-loading 'fault' on Instance uuid e9803931-931f-4c10-92de-264b813d7d3c {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:07:30.093035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69ca0baaf3854917bf6fc02883b0b949', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f0e2176993f4c61bd976aa95fe55346', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:30.116791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a5210dbd-e9cf-4fdc-8529-15c92f18496c tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 200 len: 1350 microversion: 2.1 time: 0.141747 May 18 17:07:30.129719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 138/263] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:29 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 1350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:30.135350 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f0c41287-9610-45c0-aa66-0caffe8465e3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:30.137083 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f0c41287-9610-45c0-aa66-0caffe8465e3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:30.154964 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f0c41287-9610-45c0-aa66-0caffe8465e3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:30.155824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f0c41287-9610-45c0-aa66-0caffe8465e3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:30.170797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f0c41287-9610-45c0-aa66-0caffe8465e3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:30.171776 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f0c41287-9610-45c0-aa66-0caffe8465e3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:30.355552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f0c41287-9610-45c0-aa66-0caffe8465e3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:30.365363 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f0c41287-9610-45c0-aa66-0caffe8465e3 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1470 microversion: 2.1 time: 0.252983 May 18 17:07:30.366745 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 126/264] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:30 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1470 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:30.763921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-bedb6fd2-f8b6-4c55-93fe-e3721c2b0314 req-fd3b40b1-c0b5-4382-9e48-5020d860bb71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12f7d8ea-adc0-42f8-809d-a5bacd802e68", "name": "network-vif-deleted", "tag": "bc4bae2b-9934-4607-a66c-62d32d0d00d2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:30.778499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-bedb6fd2-f8b6-4c55-93fe-e3721c2b0314 req-fd3b40b1-c0b5-4382-9e48-5020d860bb71 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:30.779613 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-bedb6fd2-f8b6-4c55-93fe-e3721c2b0314 req-fd3b40b1-c0b5-4382-9e48-5020d860bb71 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:30.791965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-bedb6fd2-f8b6-4c55-93fe-e3721c2b0314 req-fd3b40b1-c0b5-4382-9e48-5020d860bb71 service nova] Creating event network-vif-deleted:bc4bae2b-9934-4607-a66c-62d32d0d00d2 for instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 on hv-cinder-79578 May 18 17:07:30.807062 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-bedb6fd2-f8b6-4c55-93fe-e3721c2b0314 req-fd3b40b1-c0b5-4382-9e48-5020d860bb71 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047906 May 18 17:07:30.808154 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 139/265] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:07:30.891999 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-44a3d926-efda-4501-a550-33b597f1f83c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:30.893340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-44a3d926-efda-4501-a550-33b597f1f83c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:30.899908 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44a3d926-efda-4501-a550-33b597f1f83c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:30.900596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44a3d926-efda-4501-a550-33b597f1f83c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:30.902100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44a3d926-efda-4501-a550-33b597f1f83c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:30.902603 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44a3d926-efda-4501-a550-33b597f1f83c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:31.064777 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44a3d926-efda-4501-a550-33b597f1f83c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:31.073324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-44a3d926-efda-4501-a550-33b597f1f83c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.185319 May 18 17:07:31.074095 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 127/266] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:30 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:31.139347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:31.140068 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:31.146409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:31.146863 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:31.147629 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:31.148065 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:31.165204 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] HTTP exception thrown: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Request method failure captured: May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c HTTP/1.1 May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSdxW8sZQtdCqaeTv51HFTdIwttL6YKkIVCNNF9s1eP2JC21E7e6_IlYORUJGQKMugFM1hMmFkILaIB4GYnTuTtnbdBmjTNnAOvPsBt8KmMdCEfpCH4SOjLDSWU6Ac3Tih7dU3dw51GK8RSZKLE4WOHIWlySdKFv_H4LXtYcUKfpyv4 May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 0f0e2176993f4c61bd976aa95fe55346 May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:07:31.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 0f0e2176993f4c61bd976aa95fe55346 May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-DeleteServersTestJSON-1819560706-project May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 69ca0baaf3854917bf6fc02883b0b949 May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-DeleteServersTestJSON-1819560706-project May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.175037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': 'e9803931-931f-4c10-92de-264b813d7d3c'} May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:07:31.176134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.177711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:31.179726 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Returning 404 to user: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:07:31.180608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1f6c1581-d944-49c7-99be-56763bb15353 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 404 len: 111 microversion: 2.1 time: 0.047444 May 18 17:07:31.181180 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 140/267] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:31 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:07:31.295265 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:31.296262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:31.302324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:31.302765 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:31.303550 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:31.304059 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:31.321601 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] HTTP exception thrown: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Request method failure captured: May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c/os-volume_attachments HTTP/1.1 May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdxW8sZQtdCqaeTv51HFTdIwttL6YKkIVCNNF9s1eP2JC21E7e6_IlYORUJGQKMugFM1hMmFkILaIB4GYnTuTtnbdBmjTNnAOvPsBt8KmMdCEfpCH4SOjLDSWU6Ac3Tih7dU3dw51GK8RSZKLE4WOHIWlySdKFv_H4LXtYcUKfpyv4 May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0f0e2176993f4c61bd976aa95fe55346 May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:07:31.326828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0f0e2176993f4c61bd976aa95fe55346 May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-DeleteServersTestJSON-1819560706-project May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 69ca0baaf3854917bf6fc02883b0b949 May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-DeleteServersTestJSON-1819560706-project May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.327991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'server_id': 'e9803931-931f-4c10-92de-264b813d7d3c'} May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:07:31.328622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:31.330366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:31.331857 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Returning 404 to user: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:07:31.331857 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b61956b8-2bb6-4b46-99aa-e197083abe29 tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.037711 May 18 17:07:31.331857 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 128/268] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:07:31 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:07:31.383428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:31.384357 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:31.391924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:31.392436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:31.393182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:31.393524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:31.430140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:31.430683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:31.431196 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lazy-loading 'fault' on Instance uuid 12f7d8ea-adc0-42f8-809d-a5bacd802e68 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:07:31.495158 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '816046b774504e6fabbe136e42335b82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9720855c0c984b038348a02ce872b7ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:31.504488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-30ad3f83-6b55-4847-aaa2-9b9b79cddd59 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 200 len: 1305 microversion: 2.1 time: 0.124856 May 18 17:07:31.505835 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 141/269] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:31 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 1305 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:32.092752 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7f5caaf4-a2f8-4772-8fdc-51587ebd58c4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:32.093478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7f5caaf4-a2f8-4772-8fdc-51587ebd58c4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:32.100887 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7f5caaf4-a2f8-4772-8fdc-51587ebd58c4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:32.101345 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7f5caaf4-a2f8-4772-8fdc-51587ebd58c4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:32.102164 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7f5caaf4-a2f8-4772-8fdc-51587ebd58c4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:32.102601 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7f5caaf4-a2f8-4772-8fdc-51587ebd58c4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:32.334027 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7f5caaf4-a2f8-4772-8fdc-51587ebd58c4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:32.342724 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7f5caaf4-a2f8-4772-8fdc-51587ebd58c4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.255680 May 18 17:07:32.343282 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 129/270] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:32 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:32.522677 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:32.525027 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] [instance: 12f7d8ea-adc0-42f8-809d-a5bacd802e68] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:32.532209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:32.532899 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:32.533859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:32.534440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:32.552516 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] HTTP exception thrown: Instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 could not be found. May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Request method failure captured: May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 HTTP/1.1 May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSet3Tj-K_4ECgXsvn5UhY8AyKY7IpYCruyEAhUI59TwIHpPRLpb_S-Rc8pXPqAfs4WepNVCjhmrr-r3-F3j2orfUqq_87M9sNQXezCKVarz56632ID4ILSP4QO7LDxZgJKdtRrJpqcWlch2F44MEoDrnBzU1SZlPFKamvTn9Cy-LwQ May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 9720855c0c984b038348a02ce872b7ae May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesNegativeTest-1429770470 May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:07:32.554317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9720855c0c984b038348a02ce872b7ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_9720855c0c984b038348a02ce872b7ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/9720855c0c984b038348a02ce872b7ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/9720855c0c984b038348a02ce872b7ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesNegativeTest-1429770470 May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 9720855c0c984b038348a02ce872b7ae May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesNegativeTest-1429770470 May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesNegativeTest-1429770470-project May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 816046b774504e6fabbe136e42335b82 May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesNegativeTest-1429770470-project May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 could not be found. May 18 17:07:32.556151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '12f7d8ea-adc0-42f8-809d-a5bacd802e68'} May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 could not be found. May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:07:32.556826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 could not be found. May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 could not be found. May 18 17:07:32.558714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.560512 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] Returning 404 to user: Instance 12f7d8ea-adc0-42f8-809d-a5bacd802e68 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:07:32.561650 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-54aecf25-23af-47c0-81a1-14a758c9ba04 tempest-VolumesNegativeTest-1429770470 tempest-VolumesNegativeTest-1429770470-project] 10.222.0.49 "GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68" status: 404 len: 111 microversion: 2.1 time: 0.042835 May 18 17:07:32.563145 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 142/271] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:32 2022] GET /compute/v2.1/servers/12f7d8ea-adc0-42f8-809d-a5bacd802e68 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:07:32.620805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:32.620805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:32.625408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:32.625883 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:32.626677 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:32.630086 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:32.653194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] HTTP exception thrown: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Request method failure captured: May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c HTTP/1.1 May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSdxW8sZQtdCqaeTv51HFTdIwttL6YKkIVCNNF9s1eP2JC21E7e6_IlYORUJGQKMugFM1hMmFkILaIB4GYnTuTtnbdBmjTNnAOvPsBt8KmMdCEfpCH4SOjLDSWU6Ac3Tih7dU3dw51GK8RSZKLE4WOHIWlySdKFv_H4LXtYcUKfpyv4 May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0f0e2176993f4c61bd976aa95fe55346 May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:07:32.655823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0f0e2176993f4c61bd976aa95fe55346 May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-DeleteServersTestJSON-1819560706-project May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 69ca0baaf3854917bf6fc02883b0b949 May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-DeleteServersTestJSON-1819560706-project May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.657326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'e9803931-931f-4c10-92de-264b813d7d3c'} May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:07:32.658179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.659560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:07:32.667619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Returning 404 to user: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:07:32.668625 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9b4d6713-8104-47bd-8777-cae77d846a5f tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 404 len: 111 microversion: 2.1 time: 0.057003 May 18 17:07:32.672304 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 130/272] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:07:32 2022] DELETE /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:07:32.679019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:32.679612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] [instance: e9803931-931f-4c10-92de-264b813d7d3c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:32.688349 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:32.688799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:32.689576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:32.690072 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:32.726550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] HTTP exception thrown: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Request method failure captured: May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c HTTP/1.1 May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSdxW8sZQtdCqaeTv51HFTdIwttL6YKkIVCNNF9s1eP2JC21E7e6_IlYORUJGQKMugFM1hMmFkILaIB4GYnTuTtnbdBmjTNnAOvPsBt8KmMdCEfpCH4SOjLDSWU6Ac3Tih7dU3dw51GK8RSZKLE4WOHIWlySdKFv_H4LXtYcUKfpyv4 May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 0f0e2176993f4c61bd976aa95fe55346 May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:07:32.732612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0f0e2176993f4c61bd976aa95fe55346"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 0f0e2176993f4c61bd976aa95fe55346 May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-DeleteServersTestJSON-1819560706 May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-DeleteServersTestJSON-1819560706-project May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 69ca0baaf3854917bf6fc02883b0b949 May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-DeleteServersTestJSON-1819560706-project May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.734172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': 'e9803931-931f-4c10-92de-264b813d7d3c'} May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:07:32.734981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. May 18 17:07:32.736347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:07:32.738461 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] Returning 404 to user: Instance e9803931-931f-4c10-92de-264b813d7d3c could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:07:32.739535 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-023fc2f7-3b6d-4edc-93da-bc3b224e355d tempest-DeleteServersTestJSON-1819560706 tempest-DeleteServersTestJSON-1819560706-project] 10.222.0.49 "GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c" status: 404 len: 111 microversion: 2.1 time: 0.065127 May 18 17:07:32.741167 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 143/273] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:32 2022] GET /compute/v2.1/servers/e9803931-931f-4c10-92de-264b813d7d3c => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:07:33.360744 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9366c465-a368-4ba7-a255-89396ef98f38 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:33.361349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9366c465-a368-4ba7-a255-89396ef98f38 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:33.374578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9366c465-a368-4ba7-a255-89396ef98f38 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:33.374991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9366c465-a368-4ba7-a255-89396ef98f38 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:33.375766 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9366c465-a368-4ba7-a255-89396ef98f38 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:33.376202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9366c465-a368-4ba7-a255-89396ef98f38 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:33.683411 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9366c465-a368-4ba7-a255-89396ef98f38 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:33.693276 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9366c465-a368-4ba7-a255-89396ef98f38 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.336233 May 18 17:07:33.694004 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 131/274] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:33 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:34.711284 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-115b7026-1959-4a93-8da2-29b766dcd3f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:34.716686 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-115b7026-1959-4a93-8da2-29b766dcd3f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:34.725435 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-115b7026-1959-4a93-8da2-29b766dcd3f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:34.725955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-115b7026-1959-4a93-8da2-29b766dcd3f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:34.726771 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-115b7026-1959-4a93-8da2-29b766dcd3f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:34.727213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-115b7026-1959-4a93-8da2-29b766dcd3f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:34.989689 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-115b7026-1959-4a93-8da2-29b766dcd3f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:35.000710 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-115b7026-1959-4a93-8da2-29b766dcd3f4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.293519 May 18 17:07:35.002240 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 144/275] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:34 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:36.019716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-30c166a3-3d71-49fa-8971-297ca91f4c70 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:36.021759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-30c166a3-3d71-49fa-8971-297ca91f4c70 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:36.068918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-30c166a3-3d71-49fa-8971-297ca91f4c70 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:36.069374 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-30c166a3-3d71-49fa-8971-297ca91f4c70 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:36.074956 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-30c166a3-3d71-49fa-8971-297ca91f4c70 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:36.076848 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-30c166a3-3d71-49fa-8971-297ca91f4c70 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:36.410950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-30c166a3-3d71-49fa-8971-297ca91f4c70 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:36.427380 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-30c166a3-3d71-49fa-8971-297ca91f4c70 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.408632 May 18 17:07:36.428213 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 132/276] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:36 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:37.452669 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-abf1d0c4-b910-4747-8f0a-dcb3691598ba tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:37.456378 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-abf1d0c4-b910-4747-8f0a-dcb3691598ba tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:37.467721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:37.476371 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abf1d0c4-b910-4747-8f0a-dcb3691598ba tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:37.476978 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abf1d0c4-b910-4747-8f0a-dcb3691598ba tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:37.478162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abf1d0c4-b910-4747-8f0a-dcb3691598ba tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:37.479868 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abf1d0c4-b910-4747-8f0a-dcb3691598ba tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:37.824298 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-abf1d0c4-b910-4747-8f0a-dcb3691598ba tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:37.840662 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-abf1d0c4-b910-4747-8f0a-dcb3691598ba tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.394026 May 18 17:07:37.841633 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 145/277] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:37 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:38.866434 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-43084883-c556-4a67-ac7e-268a8f923cc4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:38.867051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-43084883-c556-4a67-ac7e-268a8f923cc4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:38.890599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-43084883-c556-4a67-ac7e-268a8f923cc4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:38.891532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-43084883-c556-4a67-ac7e-268a8f923cc4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:38.892663 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-43084883-c556-4a67-ac7e-268a8f923cc4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:38.893386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-43084883-c556-4a67-ac7e-268a8f923cc4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:39.272240 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-43084883-c556-4a67-ac7e-268a8f923cc4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:39.288450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-43084883-c556-4a67-ac7e-268a8f923cc4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.431633 May 18 17:07:39.289311 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 133/278] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:38 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:40.307503 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-21943c35-8d17-4950-8881-59d782b8160e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:40.308181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-21943c35-8d17-4950-8881-59d782b8160e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:40.316107 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21943c35-8d17-4950-8881-59d782b8160e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:40.317142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21943c35-8d17-4950-8881-59d782b8160e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:40.317978 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21943c35-8d17-4950-8881-59d782b8160e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:40.318798 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-21943c35-8d17-4950-8881-59d782b8160e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:41.147535 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-21943c35-8d17-4950-8881-59d782b8160e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:41.161258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-21943c35-8d17-4950-8881-59d782b8160e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.858135 May 18 17:07:41.162869 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 146/279] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:40 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:42.183140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4fbd596e-d6fe-4162-847a-b155be974417 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:42.183811 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4fbd596e-d6fe-4162-847a-b155be974417 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:42.197136 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fbd596e-d6fe-4162-847a-b155be974417 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:42.197643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fbd596e-d6fe-4162-847a-b155be974417 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:42.199916 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fbd596e-d6fe-4162-847a-b155be974417 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:42.200369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4fbd596e-d6fe-4162-847a-b155be974417 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:42.647422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4fbd596e-d6fe-4162-847a-b155be974417 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:42.663465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4fbd596e-d6fe-4162-847a-b155be974417 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.486197 May 18 17:07:42.671724 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 134/280] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:42 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:43.677950 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c54fffcb-2812-4127-88e4-27cb898d907d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'create', calling method: .version_select at 0x7fef00870af0>, body: {"keypair": {"name": "tempest-keypair-445549978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsOMJVTu0Gqjuwb30n2dvSKITVQtves/mipRBCHLKGOt5E3SC9H4N38ZQCT7d/NiaUviEBhZe84CAhyWCBNu6xlQ5AH1QIvk2i+jJv+2TByeISGLz0Xen0tqA1pIlvtkA=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:43.694845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-c54fffcb-2812-4127-88e4-27cb898d907d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Getting quotas for project 6fe001ad764a40839c0a87e48dedb14f. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:07:43.696372 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4a24b241-7593-4bb6-a802-6acb9b0574ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:43.699215 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4a24b241-7593-4bb6-a802-6acb9b0574ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:43.701187 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-c54fffcb-2812-4127-88e4-27cb898d907d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Getting quotas for user 13b9ab17cee74e8282cd86a37eaf19aa and project 6fe001ad764a40839c0a87e48dedb14f. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:07:43.711264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a24b241-7593-4bb6-a802-6acb9b0574ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:43.714478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a24b241-7593-4bb6-a802-6acb9b0574ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:43.717998 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a24b241-7593-4bb6-a802-6acb9b0574ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:43.723480 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a24b241-7593-4bb6-a802-6acb9b0574ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:43.746715 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c54fffcb-2812-4127-88e4-27cb898d907d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.250224 May 18 17:07:43.753857 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 147/281] 10.222.0.49 () {62 vars in 1199 bytes} [Wed May 18 17:07:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 257 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 18 17:07:44.019084 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4a24b241-7593-4bb6-a802-6acb9b0574ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:44.035792 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4a24b241-7593-4bb6-a802-6acb9b0574ee tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.351461 May 18 17:07:44.036969 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 135/282] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:43 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:45.060268 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2ee65127-2cc6-4486-b038-d6ffcdbe9ae7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:45.063215 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2ee65127-2cc6-4486-b038-d6ffcdbe9ae7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:45.081795 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ee65127-2cc6-4486-b038-d6ffcdbe9ae7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:45.082905 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ee65127-2cc6-4486-b038-d6ffcdbe9ae7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:45.084484 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ee65127-2cc6-4486-b038-d6ffcdbe9ae7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:45.085278 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2ee65127-2cc6-4486-b038-d6ffcdbe9ae7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:45.129910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:45.406022 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2ee65127-2cc6-4486-b038-d6ffcdbe9ae7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:45.425779 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2ee65127-2cc6-4486-b038-d6ffcdbe9ae7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.374925 May 18 17:07:45.430696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 148/283] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:45 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:45.690739 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1900445849", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "befffa0d-bc76-4fb5-90a1-9d8502254252"}], "security_groups": [{"name": "tempest-securitygroup--1497519918"}], "key_name": "tempest-keypair-445549978", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:45.832617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] validate_networks() for [('befffa0d-bc76-4fb5-90a1-9d8502254252', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:07:45.942849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1b74f340-99d7-4ad6-a7d3-4ed86c6b2248 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Action: 'create', calling method: .version_select at 0x7feef3d723a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-623668497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMl+F7EcWgc3NiKwbzktoSFBy3LRHvHOIsqtGAa0FgVtGSV24f9AtLpLMjqBC1jgoTEZDieCP4mwOp+FCXyN3S3pG/m7oOJOyuKTPwZl7dVUuEXT22/CumQlAiWonD5etg=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:45.971004 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-1b74f340-99d7-4ad6-a7d3-4ed86c6b2248 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Getting quotas for project 10568aeb4aba423585e0668a4a5e05d9. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:07:45.977479 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-1b74f340-99d7-4ad6-a7d3-4ed86c6b2248 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Getting quotas for user edf6a4f02eb34720b0126d17db1c1b86 and project 10568aeb4aba423585e0668a4a5e05d9. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:07:46.018459 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1b74f340-99d7-4ad6-a7d3-4ed86c6b2248 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.292926 May 18 17:07:46.019083 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 149/284] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:07:45 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:46.453256 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-743feb73-e78f-4826-b25b-08797997dee6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:46.454602 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-743feb73-e78f-4826-b25b-08797997dee6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:46.487337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-743feb73-e78f-4826-b25b-08797997dee6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:46.488063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-743feb73-e78f-4826-b25b-08797997dee6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:46.489410 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-743feb73-e78f-4826-b25b-08797997dee6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:46.489908 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-743feb73-e78f-4826-b25b-08797997dee6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:46.620842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:07:46.621458 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:07:46.622111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:07:46.622663 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:07:46.623244 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:07:46.639448 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:46.639892 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:46.640689 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:46.641128 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:46.687750 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Getting quotas for project 6fe001ad764a40839c0a87e48dedb14f. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:07:46.708915 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Getting quotas for user 13b9ab17cee74e8282cd86a37eaf19aa and project 6fe001ad764a40839c0a87e48dedb14f. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:07:46.743881 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:07:46.755454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:07:46.846997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9cac0d0a-c91d-46ef-9cbd-b8c989be9336 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.164874 May 18 17:07:46.851351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 136/285] 10.222.0.49 () {62 vars in 1187 bytes} [Wed May 18 17:07:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 18 17:07:46.859677 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-289b6318-5b5c-403c-895f-2bb5be9e9b23 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:46.868586 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-743feb73-e78f-4826-b25b-08797997dee6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:46.872789 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-289b6318-5b5c-403c-895f-2bb5be9e9b23 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:46.902670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-743feb73-e78f-4826-b25b-08797997dee6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.457265 May 18 17:07:46.904395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 150/286] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:46 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:46.997463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-289b6318-5b5c-403c-895f-2bb5be9e9b23 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:47.006180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-289b6318-5b5c-403c-895f-2bb5be9e9b23 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:47.007699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-289b6318-5b5c-403c-895f-2bb5be9e9b23 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:47.008940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-289b6318-5b5c-403c-895f-2bb5be9e9b23 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1281 microversion: 2.20 time: 0.153337 May 18 17:07:47.009458 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 137/287] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:46 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1281 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:07:47.920920 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b7c2e042-69c2-4a32-ac82-464e36e3d784 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:47.921542 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b7c2e042-69c2-4a32-ac82-464e36e3d784 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:47.928234 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7c2e042-69c2-4a32-ac82-464e36e3d784 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:47.928683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7c2e042-69c2-4a32-ac82-464e36e3d784 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:47.929593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7c2e042-69c2-4a32-ac82-464e36e3d784 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:47.930055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7c2e042-69c2-4a32-ac82-464e36e3d784 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:48.028644 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:48.030030 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:48.033581 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:48.037311 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:48.037851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:48.038701 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:48.039233 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:48.083120 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b7c2e042-69c2-4a32-ac82-464e36e3d784 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:48.092093 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b7c2e042-69c2-4a32-ac82-464e36e3d784 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.175808 May 18 17:07:48.093357 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 151/288] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:47 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:48.112992 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:48.121883 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:48.123395 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:48.124944 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e6f729f0-8246-468e-8693-c458854b50fd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1285 microversion: 2.20 time: 0.100861 May 18 17:07:48.126073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 138/289] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:48 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:07:49.110476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ce9da79c-9e9f-4354-998a-3a9947477af3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:49.111082 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ce9da79c-9e9f-4354-998a-3a9947477af3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:49.117111 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ce9da79c-9e9f-4354-998a-3a9947477af3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:49.117490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ce9da79c-9e9f-4354-998a-3a9947477af3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:49.118330 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ce9da79c-9e9f-4354-998a-3a9947477af3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:49.118760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ce9da79c-9e9f-4354-998a-3a9947477af3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:49.143325 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:49.143928 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:49.150972 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:49.151422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:49.152194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:49.152627 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:49.219955 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:49.229910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:49.231664 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:49.232855 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2ae4244c-9cec-4929-a6db-6b62b12220b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1285 microversion: 2.20 time: 0.093383 May 18 17:07:49.233413 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 139/290] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:49 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:07:49.272180 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ce9da79c-9e9f-4354-998a-3a9947477af3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:49.281177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ce9da79c-9e9f-4354-998a-3a9947477af3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.174530 May 18 17:07:49.281924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 152/291] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:49 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:50.250830 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:50.252310 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:50.259703 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:50.260313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:50.261313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:50.263622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:50.299959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-eb1edb0f-035a-4fde-a6d0-97b1b5033018 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:50.300577 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-eb1edb0f-035a-4fde-a6d0-97b1b5033018 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:50.307755 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eb1edb0f-035a-4fde-a6d0-97b1b5033018 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:50.308208 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eb1edb0f-035a-4fde-a6d0-97b1b5033018 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:50.309167 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eb1edb0f-035a-4fde-a6d0-97b1b5033018 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:50.309817 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eb1edb0f-035a-4fde-a6d0-97b1b5033018 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:50.334387 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:50.343181 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:50.344790 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:50.346217 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3e49d2fb-45fa-43b5-807c-3bb306bb720c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1285 microversion: 2.20 time: 0.099407 May 18 17:07:50.346850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 140/292] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:50 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:07:50.465681 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-eb1edb0f-035a-4fde-a6d0-97b1b5033018 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:50.474329 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-eb1edb0f-035a-4fde-a6d0-97b1b5033018 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.179025 May 18 17:07:50.475946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 153/293] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:50 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:51.364574 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:51.365190 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:51.373451 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:51.374655 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:51.374950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:51.375395 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:51.442876 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:51.452642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:51.454071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:51.455195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b19ecb03-5597-466c-aece-1897c464d1b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1285 microversion: 2.20 time: 0.094731 May 18 17:07:51.455760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 141/294] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:51 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:07:51.491851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-10753f13-184a-47bb-b086-3204d9c1d61d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:51.492387 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-10753f13-184a-47bb-b086-3204d9c1d61d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:51.499690 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10753f13-184a-47bb-b086-3204d9c1d61d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:51.500142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10753f13-184a-47bb-b086-3204d9c1d61d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:51.500920 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10753f13-184a-47bb-b086-3204d9c1d61d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:51.501537 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10753f13-184a-47bb-b086-3204d9c1d61d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:51.664113 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10753f13-184a-47bb-b086-3204d9c1d61d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:51.673131 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-10753f13-184a-47bb-b086-3204d9c1d61d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.185137 May 18 17:07:51.673880 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 154/295] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:51 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:52.477697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:52.479483 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:52.512873 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:52.516193 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:52.520538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:52.522766 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:52.637187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:52.676273 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:52.680030 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:52.686089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7d1970a8-cc78-47ec-8ff1-e766ccdd12fe tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1285 microversion: 2.20 time: 0.212264 May 18 17:07:52.690669 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-788f6d7a-1455-45c8-a372-9a878e9fbd87 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:52.691803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-788f6d7a-1455-45c8-a372-9a878e9fbd87 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:52.698255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 142/296] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:52 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1285 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:07:52.705250 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-788f6d7a-1455-45c8-a372-9a878e9fbd87 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:52.705757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-788f6d7a-1455-45c8-a372-9a878e9fbd87 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:52.706545 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-788f6d7a-1455-45c8-a372-9a878e9fbd87 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:52.706980 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-788f6d7a-1455-45c8-a372-9a878e9fbd87 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:53.408841 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-788f6d7a-1455-45c8-a372-9a878e9fbd87 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:53.419805 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-788f6d7a-1455-45c8-a372-9a878e9fbd87 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1522 microversion: 2.1 time: 0.733132 May 18 17:07:53.429826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 155/297] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:52 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1522 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:53.717120 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:53.719893 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:53.755043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:53.762912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:53.765923 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:53.766422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:53.797023 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:53.956355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:53.966381 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:53.970553 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:53.976733 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5c988d79-4a0c-47e5-94b5-4c95116c947c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1341 microversion: 2.20 time: 0.273496 May 18 17:07:53.980354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 143/298] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:53 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1341 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:07:54.441010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-47b8becd-873a-49d5-ac90-fa89e2a0dc68 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:54.442477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-47b8becd-873a-49d5-ac90-fa89e2a0dc68 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:54.452599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47b8becd-873a-49d5-ac90-fa89e2a0dc68 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:54.453434 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47b8becd-873a-49d5-ac90-fa89e2a0dc68 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:54.454515 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47b8becd-873a-49d5-ac90-fa89e2a0dc68 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:54.455232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47b8becd-873a-49d5-ac90-fa89e2a0dc68 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:54.637452 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-47b8becd-873a-49d5-ac90-fa89e2a0dc68 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:54.646634 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-47b8becd-873a-49d5-ac90-fa89e2a0dc68 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1502 microversion: 2.1 time: 0.212808 May 18 17:07:54.647764 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 156/299] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:54 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:07:54.668319 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2a5235c3-13de-4a78-9686-4ab22d01037a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:54.668939 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2a5235c3-13de-4a78-9686-4ab22d01037a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:54.680823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a5235c3-13de-4a78-9686-4ab22d01037a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:54.681279 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a5235c3-13de-4a78-9686-4ab22d01037a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:54.682757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a5235c3-13de-4a78-9686-4ab22d01037a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:54.683974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a5235c3-13de-4a78-9686-4ab22d01037a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:54.910208 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2a5235c3-13de-4a78-9686-4ab22d01037a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:54.920234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2a5235c3-13de-4a78-9686-4ab22d01037a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1517 microversion: 2.1 time: 0.259238 May 18 17:07:54.920918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 144/300] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:07:54 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1517 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:07:55.001287 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:55.001933 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:55.011063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:55.011841 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:55.012880 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:55.014183 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:55.214470 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:55.224652 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:55.226597 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:55.229624 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-91261666-3b43-404c-beae-f555e2d13bce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.231954 May 18 17:07:55.231251 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 157/301] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:54 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:07:56.248987 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:56.249591 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:56.256249 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:56.256696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:56.257465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:56.257926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:56.395793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:56.405098 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:56.406646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:56.407759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-008c95fe-441d-40a1-acaa-3d1ec1372ce9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.162685 May 18 17:07:56.416362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 145/302] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:56 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:07:57.427053 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:57.427667 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:57.429559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=8 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:57.435902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:57.436344 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:57.437116 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:57.437541 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:57.571847 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:57.580348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:57.581897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:57.582997 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ba4855ef-8df1-4607-bc7f-ca06a7f5c489 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.160180 May 18 17:07:57.583547 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 158/303] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:57 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:07:58.603751 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:58.604365 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:58.608036 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:58.608851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=8 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:07:58.612847 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:58.613331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:58.614131 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:58.614564 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:58.819260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:58.829126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:58.830670 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:07:58.831789 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ecbb86fc-c520-4738-bd9d-92796232713f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.232214 May 18 17:07:58.832354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 146/304] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:58 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:07:58.882012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-204a7131-13d4-40c6-abee-db1f4f9f6f14 req-5b5af63b-c265-4401-b6a5-bd38e6bf06e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9559237-c858-41a6-ba99-09106ba78496", "tag": "a59f32ad-7870-4083-b0d4-262a85cedd52"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:07:58.891971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-204a7131-13d4-40c6-abee-db1f4f9f6f14 req-5b5af63b-c265-4401-b6a5-bd38e6bf06e8 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:58.892423 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-204a7131-13d4-40c6-abee-db1f4f9f6f14 req-5b5af63b-c265-4401-b6a5-bd38e6bf06e8 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:58.906860 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-204a7131-13d4-40c6-abee-db1f4f9f6f14 req-5b5af63b-c265-4401-b6a5-bd38e6bf06e8 service nova] Creating event network-changed:a59f32ad-7870-4083-b0d4-262a85cedd52 for instance e9559237-c858-41a6-ba99-09106ba78496 on hv-cinder-79578 May 18 17:07:58.912157 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-204a7131-13d4-40c6-abee-db1f4f9f6f14 req-5b5af63b-c265-4401-b6a5-bd38e6bf06e8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035617 May 18 17:07:58.912755 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 159/305] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:07:59.850209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:07:59.850817 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:07:59.857578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:59.858039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:59.858803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:07:59.859241 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:07:59.993111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:00.007990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:00.012455 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:00.013858 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4ed9a8c9-a8b3-493d-b6d9-a6f0a5c29035 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.167448 May 18 17:08:00.024165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 147/306] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:07:59 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:01.031885 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:01.032618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:01.038818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:01.039266 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:01.040022 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:01.040455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:01.182422 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:01.190481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:01.191985 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:01.193083 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a94a2268-fb9d-4874-a24a-224b6843efd9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.165524 May 18 17:08:01.193643 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 160/307] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:01 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:02.218742 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:02.219851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:02.233435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:02.234639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:02.236483 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:02.237576 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:02.377384 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:02.387055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:02.388556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:02.389691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bd4de4ff-2077-42f3-87c2-344429d1d67b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.181695 May 18 17:08:02.390273 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 148/308] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:02 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:03.407839 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:03.408485 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:03.414769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:03.415201 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:03.416544 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:03.417071 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:03.550493 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:03.558614 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:03.560120 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:03.561215 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2aa32f2b-1009-4def-8939-26c403a467a9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.157444 May 18 17:08:03.561796 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 161/309] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:03 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:08:03.798940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4b5099da-4d44-435a-9ec2-4be1b4117278 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:03.799945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4b5099da-4d44-435a-9ec2-4be1b4117278 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:03.808706 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b5099da-4d44-435a-9ec2-4be1b4117278 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:03.809152 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b5099da-4d44-435a-9ec2-4be1b4117278 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:03.809980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b5099da-4d44-435a-9ec2-4be1b4117278 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:03.810670 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b5099da-4d44-435a-9ec2-4be1b4117278 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:03.834998 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-4b5099da-4d44-435a-9ec2-4be1b4117278 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lazy-loading 'flavor' on Instance uuid 8a1e5ac3-2af5-4bee-a830-1f6014618699 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:08:03.965777 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4b5099da-4d44-435a-9ec2-4be1b4117278 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699/action" status: 200 len: 32 microversion: 2.1 time: 0.170667 May 18 17:08:03.966425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 149/310] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:08:03 2022] POST /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 17:08:03.975458 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-84673d5d-eb49-4d6e-bfaf-85f5b4b9f7dc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:03.976164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-84673d5d-eb49-4d6e-bfaf-85f5b4b9f7dc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:03.982635 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84673d5d-eb49-4d6e-bfaf-85f5b4b9f7dc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:03.983088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84673d5d-eb49-4d6e-bfaf-85f5b4b9f7dc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:03.983870 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84673d5d-eb49-4d6e-bfaf-85f5b4b9f7dc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:03.984312 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84673d5d-eb49-4d6e-bfaf-85f5b4b9f7dc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:04.126645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-84673d5d-eb49-4d6e-bfaf-85f5b4b9f7dc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:04.135440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-84673d5d-eb49-4d6e-bfaf-85f5b4b9f7dc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.163693 May 18 17:08:04.136017 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 162/311] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:03 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:04.580238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:04.581117 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:04.588219 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:04.589274 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:04.590113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:04.590553 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:04.732739 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:04.741022 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:04.742554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:04.743662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0822e864-3f31-4f4b-b5dc-d387fcd710a8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.168131 May 18 17:08:04.744310 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 150/312] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:04 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:05.152809 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ed4c6f8e-99c2-4e35-843a-ba1bbbd18f2d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:05.153411 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ed4c6f8e-99c2-4e35-843a-ba1bbbd18f2d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:05.159468 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed4c6f8e-99c2-4e35-843a-ba1bbbd18f2d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:05.159914 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed4c6f8e-99c2-4e35-843a-ba1bbbd18f2d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:05.160679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed4c6f8e-99c2-4e35-843a-ba1bbbd18f2d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:05.161115 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed4c6f8e-99c2-4e35-843a-ba1bbbd18f2d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:05.299660 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ed4c6f8e-99c2-4e35-843a-ba1bbbd18f2d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:05.307284 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ed4c6f8e-99c2-4e35-843a-ba1bbbd18f2d tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.158659 May 18 17:08:05.307953 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 163/313] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:05 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:05.762093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:05.762698 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:05.769409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:05.769929 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:05.770705 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:05.771142 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:05.912389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:05.920386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:05.921944 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:05.923047 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4b281321-49dc-4e28-8612-710616ca01e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.165160 May 18 17:08:05.923624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 151/314] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:05 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:06.324937 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-366ee687-6c5c-4559-b6ed-dae2be70bdde tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:06.325466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-366ee687-6c5c-4559-b6ed-dae2be70bdde tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:06.331558 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-366ee687-6c5c-4559-b6ed-dae2be70bdde tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:06.332010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-366ee687-6c5c-4559-b6ed-dae2be70bdde tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:06.332767 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-366ee687-6c5c-4559-b6ed-dae2be70bdde tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:06.333204 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-366ee687-6c5c-4559-b6ed-dae2be70bdde tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:06.474170 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-366ee687-6c5c-4559-b6ed-dae2be70bdde tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:06.483390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-366ee687-6c5c-4559-b6ed-dae2be70bdde tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.163230 May 18 17:08:06.483973 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 164/315] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:06 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:06.942352 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:06.942982 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:06.950392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:06.950839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:06.951598 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:06.952039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:07.085187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:07.093551 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:07.095066 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:07.096172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-955a27a5-fbad-488c-a819-f012e33a3546 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.157824 May 18 17:08:07.096745 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 152/316] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:06 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:07.501825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2a42b3b2-472c-4dcf-a42b-15c2b8027b54 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:07.502439 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2a42b3b2-472c-4dcf-a42b-15c2b8027b54 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:07.508918 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2a42b3b2-472c-4dcf-a42b-15c2b8027b54 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:07.509368 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2a42b3b2-472c-4dcf-a42b-15c2b8027b54 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:07.510292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2a42b3b2-472c-4dcf-a42b-15c2b8027b54 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:07.510862 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2a42b3b2-472c-4dcf-a42b-15c2b8027b54 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:07.647251 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2a42b3b2-472c-4dcf-a42b-15c2b8027b54 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:07.655031 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2a42b3b2-472c-4dcf-a42b-15c2b8027b54 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.157182 May 18 17:08:07.655598 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 165/317] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:07 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:08.115587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:08.116198 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:08.122748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:08.123196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:08.123959 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:08.124394 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:08.260438 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:08.268943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:08.270530 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:08.271639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d4ea3285-bc0f-41c6-919a-af81da87a8c7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.159956 May 18 17:08:08.272195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 153/318] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:08 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:08.673637 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c40d1d10-fd59-4c2d-80e7-b15c2f473f5c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:08.674358 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c40d1d10-fd59-4c2d-80e7-b15c2f473f5c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:08.676240 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:08.681832 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c40d1d10-fd59-4c2d-80e7-b15c2f473f5c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:08.682942 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c40d1d10-fd59-4c2d-80e7-b15c2f473f5c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:08.683730 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c40d1d10-fd59-4c2d-80e7-b15c2f473f5c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:08.684176 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c40d1d10-fd59-4c2d-80e7-b15c2f473f5c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:08.824581 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c40d1d10-fd59-4c2d-80e7-b15c2f473f5c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:08.827419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:08.833995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c40d1d10-fd59-4c2d-80e7-b15c2f473f5c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.164192 May 18 17:08:08.834566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 166/319] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:08 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:09.291008 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:09.291922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:09.298757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:09.299223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:09.300073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:09.300501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:09.447374 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:09.460439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:09.461999 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:09.463166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9c3cd3b1-c8fe-4087-b7dd-62072195bbba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.176423 May 18 17:08:09.464154 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 154/320] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:09 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:09.851701 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6f7cbede-dfbc-48fa-8d29-3a5b38f617c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:09.852312 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6f7cbede-dfbc-48fa-8d29-3a5b38f617c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:09.859199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6f7cbede-dfbc-48fa-8d29-3a5b38f617c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:09.860672 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6f7cbede-dfbc-48fa-8d29-3a5b38f617c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:09.861428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6f7cbede-dfbc-48fa-8d29-3a5b38f617c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:09.861887 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6f7cbede-dfbc-48fa-8d29-3a5b38f617c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:09.993143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6f7cbede-dfbc-48fa-8d29-3a5b38f617c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:10.001341 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6f7cbede-dfbc-48fa-8d29-3a5b38f617c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.153660 May 18 17:08:10.001942 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 167/321] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:09 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:10.480430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:10.481127 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:10.487757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:10.488204 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:10.488996 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:10.489422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:10.631846 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:10.641038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:10.642587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:10.643696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-eb0c14f3-c427-4e66-b993-aa1ae74312a4 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.167424 May 18 17:08:10.644380 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 155/322] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:10 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:11.018751 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b83b856-f1d3-4396-99e7-9f534063e2ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:11.019363 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5b83b856-f1d3-4396-99e7-9f534063e2ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:11.025383 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b83b856-f1d3-4396-99e7-9f534063e2ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:11.025869 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b83b856-f1d3-4396-99e7-9f534063e2ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:11.026631 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b83b856-f1d3-4396-99e7-9f534063e2ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:11.027067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5b83b856-f1d3-4396-99e7-9f534063e2ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:11.160119 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5b83b856-f1d3-4396-99e7-9f534063e2ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:11.168601 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b83b856-f1d3-4396-99e7-9f534063e2ab tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.153106 May 18 17:08:11.173949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 168/323] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:11 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:11.664821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:11.665447 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:11.673172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:11.673628 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:11.674472 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:11.674913 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:11.818620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:11.829159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:11.830695 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:11.831937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-eb268777-76f5-4a8c-a7d6-133078c0b141 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.171486 May 18 17:08:11.832496 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 156/324] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:11 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:12.186782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0fc78667-730a-4404-9296-14d70dbec70e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:12.187410 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0fc78667-730a-4404-9296-14d70dbec70e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:12.193969 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fc78667-730a-4404-9296-14d70dbec70e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:12.194420 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fc78667-730a-4404-9296-14d70dbec70e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:12.195188 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fc78667-730a-4404-9296-14d70dbec70e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:12.195615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fc78667-730a-4404-9296-14d70dbec70e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:12.337996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0fc78667-730a-4404-9296-14d70dbec70e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:12.346556 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0fc78667-730a-4404-9296-14d70dbec70e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.164825 May 18 17:08:12.347143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 169/325] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:12 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:12.850852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:12.851419 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:12.858077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:12.858528 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:12.859291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:12.859729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:12.997485 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:13.005933 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:13.007420 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:13.008536 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-44ac9fee-8a12-4988-a06b-de35849d8b4a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.161661 May 18 17:08:13.009089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 157/326] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:12 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:13.363390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c3a0d33b-1987-4c57-8f64-983a724b1585 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:13.364006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c3a0d33b-1987-4c57-8f64-983a724b1585 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:13.371819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c3a0d33b-1987-4c57-8f64-983a724b1585 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:13.372279 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c3a0d33b-1987-4c57-8f64-983a724b1585 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:13.373057 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c3a0d33b-1987-4c57-8f64-983a724b1585 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:13.373499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c3a0d33b-1987-4c57-8f64-983a724b1585 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:13.513759 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c3a0d33b-1987-4c57-8f64-983a724b1585 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:13.521229 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c3a0d33b-1987-4c57-8f64-983a724b1585 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.161776 May 18 17:08:13.521814 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 170/327] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:13 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:14.030915 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:14.031995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:14.043686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:14.045147 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:14.046637 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:14.047397 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:14.060552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:14.203044 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:14.211483 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:14.213073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:14.214754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6d9d9e2e-0015-4ccc-88cb-b15c5b5e927d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.192053 May 18 17:08:14.215381 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 158/328] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:14 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:14.538308 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0680dedb-a4ad-431c-9b07-30365c0d24d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:14.538933 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0680dedb-a4ad-431c-9b07-30365c0d24d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:14.546090 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0680dedb-a4ad-431c-9b07-30365c0d24d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:14.546537 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0680dedb-a4ad-431c-9b07-30365c0d24d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:14.547299 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0680dedb-a4ad-431c-9b07-30365c0d24d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:14.547748 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0680dedb-a4ad-431c-9b07-30365c0d24d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:14.683894 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0680dedb-a4ad-431c-9b07-30365c0d24d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:14.691415 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0680dedb-a4ad-431c-9b07-30365c0d24d4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.156893 May 18 17:08:14.691987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 171/329] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:14 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:15.235532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:15.236676 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:15.244302 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:15.244758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:15.245538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:15.246003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:15.378690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:15.386713 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:15.388886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:15.390000 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8c5809eb-d38c-4d74-94a8-7ba04146ce4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.160126 May 18 17:08:15.390557 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 159/330] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:15 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:15.708789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5928b82d-2633-4010-9185-9201fa8aba6b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:15.709400 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5928b82d-2633-4010-9185-9201fa8aba6b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:15.715717 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5928b82d-2633-4010-9185-9201fa8aba6b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:15.716386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5928b82d-2633-4010-9185-9201fa8aba6b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:15.717311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5928b82d-2633-4010-9185-9201fa8aba6b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:15.717778 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5928b82d-2633-4010-9185-9201fa8aba6b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:15.852703 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5928b82d-2633-4010-9185-9201fa8aba6b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:15.861841 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5928b82d-2633-4010-9185-9201fa8aba6b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.156575 May 18 17:08:15.862435 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 172/331] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:15 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:16.408209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:16.409215 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:16.415617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:16.416275 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:16.417242 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:16.417695 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:16.563000 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:16.570858 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:16.572351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:16.573444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-38d2e8cd-af81-4ae7-b952-889343f734d8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.169392 May 18 17:08:16.574090 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 160/332] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:16 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:16.878818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-374b06c2-8d5d-4243-8370-e5adf6ade9b4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:16.879511 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-374b06c2-8d5d-4243-8370-e5adf6ade9b4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:16.885554 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-374b06c2-8d5d-4243-8370-e5adf6ade9b4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:16.886048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-374b06c2-8d5d-4243-8370-e5adf6ade9b4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:16.886812 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-374b06c2-8d5d-4243-8370-e5adf6ade9b4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:16.887253 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-374b06c2-8d5d-4243-8370-e5adf6ade9b4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:17.018338 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-374b06c2-8d5d-4243-8370-e5adf6ade9b4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:17.025819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-374b06c2-8d5d-4243-8370-e5adf6ade9b4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.150890 May 18 17:08:17.026307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 173/333] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:16 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:17.593957 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:17.595183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:17.605515 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:17.605998 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:17.606768 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:17.607502 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:17.895710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:17.904376 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:17.905975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:17.907329 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8b539885-ddef-4d25-ac99-c67aac41b4bd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.319649 May 18 17:08:17.907910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 161/334] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:17 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:18.046097 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bf584fb3-0e13-4ad2-9cd5-d4feb67b6d28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:18.050190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bf584fb3-0e13-4ad2-9cd5-d4feb67b6d28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:18.056983 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf584fb3-0e13-4ad2-9cd5-d4feb67b6d28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:18.057881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf584fb3-0e13-4ad2-9cd5-d4feb67b6d28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:18.058912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf584fb3-0e13-4ad2-9cd5-d4feb67b6d28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:18.059621 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf584fb3-0e13-4ad2-9cd5-d4feb67b6d28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:18.212735 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bf584fb3-0e13-4ad2-9cd5-d4feb67b6d28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:18.220669 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bf584fb3-0e13-4ad2-9cd5-d4feb67b6d28 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.179972 May 18 17:08:18.221244 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 174/335] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:18 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:18.930355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:18.930355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:18.930355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=48 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:18.935463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:18.935902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:18.936697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:18.939129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:19.080913 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:19.089136 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:19.090662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:19.091763 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e43fffbb-16f7-45c8-8341-3e1adec80704 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.168514 May 18 17:08:19.092323 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 162/336] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:18 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:19.240905 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f12c48a2-67be-42a9-89bc-2b9eb65116f8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:19.241506 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f12c48a2-67be-42a9-89bc-2b9eb65116f8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:19.248472 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f12c48a2-67be-42a9-89bc-2b9eb65116f8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:19.249005 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f12c48a2-67be-42a9-89bc-2b9eb65116f8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:19.250232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f12c48a2-67be-42a9-89bc-2b9eb65116f8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:19.250756 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f12c48a2-67be-42a9-89bc-2b9eb65116f8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:19.401981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f12c48a2-67be-42a9-89bc-2b9eb65116f8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:19.410662 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f12c48a2-67be-42a9-89bc-2b9eb65116f8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.173884 May 18 17:08:19.411274 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 175/337] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:19 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:19.585738 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-c1c80b47-2822-4d61-8cee-3c58ba7f96a5 req-35016b4c-4cfe-422b-ad33-270fc19ede7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9559237-c858-41a6-ba99-09106ba78496", "name": "network-vif-plugged", "status": "completed", "tag": "a59f32ad-7870-4083-b0d4-262a85cedd52"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:19.596423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c1c80b47-2822-4d61-8cee-3c58ba7f96a5 req-35016b4c-4cfe-422b-ad33-270fc19ede7b service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:19.596764 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c1c80b47-2822-4d61-8cee-3c58ba7f96a5 req-35016b4c-4cfe-422b-ad33-270fc19ede7b service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:19.612041 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-c1c80b47-2822-4d61-8cee-3c58ba7f96a5 req-35016b4c-4cfe-422b-ad33-270fc19ede7b service nova] Creating event network-vif-plugged:a59f32ad-7870-4083-b0d4-262a85cedd52 for instance e9559237-c858-41a6-ba99-09106ba78496 on hv-cinder-79578 May 18 17:08:19.617583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-c1c80b47-2822-4d61-8cee-3c58ba7f96a5 req-35016b4c-4cfe-422b-ad33-270fc19ede7b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035461 May 18 17:08:19.618374 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 163/338] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:08:20.110613 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:20.111215 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:20.118023 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:20.118498 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:20.119228 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:20.119652 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:20.290360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:20.299277 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:20.300910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:20.302975 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-294da4b9-190f-4a3a-8630-4df3f0fdfffa tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.196243 May 18 17:08:20.303308 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 176/339] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:20 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:08:20.428669 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a47328c4-ce41-4c6b-b139-d0cf297cb4bc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:20.429389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a47328c4-ce41-4c6b-b139-d0cf297cb4bc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:20.436198 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a47328c4-ce41-4c6b-b139-d0cf297cb4bc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:20.437145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a47328c4-ce41-4c6b-b139-d0cf297cb4bc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:20.437937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a47328c4-ce41-4c6b-b139-d0cf297cb4bc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:20.438373 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a47328c4-ce41-4c6b-b139-d0cf297cb4bc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:20.596502 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a47328c4-ce41-4c6b-b139-d0cf297cb4bc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:20.604099 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a47328c4-ce41-4c6b-b139-d0cf297cb4bc tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.179659 May 18 17:08:20.604670 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 164/340] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:20 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:21.321395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:21.322012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:21.329396 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:21.329891 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:21.330689 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:21.331128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:21.468838 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:21.476704 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:21.478394 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:21.479493 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bc90d67d-8634-4516-97de-ead5c72265bf tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.162091 May 18 17:08:21.480045 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 177/341] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:21 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:21.622151 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-756f4f91-d5ff-41c2-a183-ff1e5bfd3d8a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:21.622697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-756f4f91-d5ff-41c2-a183-ff1e5bfd3d8a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:21.630536 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-756f4f91-d5ff-41c2-a183-ff1e5bfd3d8a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:21.631018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-756f4f91-d5ff-41c2-a183-ff1e5bfd3d8a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:21.631786 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-756f4f91-d5ff-41c2-a183-ff1e5bfd3d8a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:21.632224 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-756f4f91-d5ff-41c2-a183-ff1e5bfd3d8a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:21.762401 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-756f4f91-d5ff-41c2-a183-ff1e5bfd3d8a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:21.770478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-756f4f91-d5ff-41c2-a183-ff1e5bfd3d8a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.152196 May 18 17:08:21.771042 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 165/342] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:21 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:22.497949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:22.498587 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:22.505225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:22.505682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:22.506476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:22.506900 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:22.639919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:22.648164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:22.649695 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:22.650811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-91a9b43d-d7b3-43b4-a613-b3c21d3ca941 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1407 microversion: 2.20 time: 0.156796 May 18 17:08:22.651374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 178/343] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:22 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:22.787947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-05851a63-5b9e-4867-94d2-c16bd5239694 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:22.788664 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-05851a63-5b9e-4867-94d2-c16bd5239694 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:22.795170 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-05851a63-5b9e-4867-94d2-c16bd5239694 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:22.795614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-05851a63-5b9e-4867-94d2-c16bd5239694 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:22.797235 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-05851a63-5b9e-4867-94d2-c16bd5239694 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:22.797917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-05851a63-5b9e-4867-94d2-c16bd5239694 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:22.944175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-05851a63-5b9e-4867-94d2-c16bd5239694 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:22.953446 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-05851a63-5b9e-4867-94d2-c16bd5239694 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.169209 May 18 17:08:22.963661 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 166/344] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:22 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:23.668927 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:23.669543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:23.675659 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:23.676120 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:23.676887 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:23.677328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:23.810037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:23.818318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:23.819830 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:23.820981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-16351bfa-ded8-422f-b0df-470499bec48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1598 microversion: 2.20 time: 0.155998 May 18 17:08:23.821543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 179/345] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:08:23 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1598 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:08:23.838685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4ad39748-e94c-41f3-9bd2-6139bab8c6c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:23.839427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4ad39748-e94c-41f3-9bd2-6139bab8c6c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:23.846730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ad39748-e94c-41f3-9bd2-6139bab8c6c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:23.847169 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ad39748-e94c-41f3-9bd2-6139bab8c6c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:23.847917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ad39748-e94c-41f3-9bd2-6139bab8c6c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:23.848348 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ad39748-e94c-41f3-9bd2-6139bab8c6c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:23.924541 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4ad39748-e94c-41f3-9bd2-6139bab8c6c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.089697 May 18 17:08:23.925134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 167/346] 10.222.0.49 () {60 vars in 1315 bytes} [Wed May 18 17:08:23 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:08:23.971332 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0d618801-961b-404b-b5b4-f52de72c1368 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:23.971940 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0d618801-961b-404b-b5b4-f52de72c1368 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:23.977867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d618801-961b-404b-b5b4-f52de72c1368 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:23.978466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d618801-961b-404b-b5b4-f52de72c1368 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:23.979219 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d618801-961b-404b-b5b4-f52de72c1368 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:23.979648 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d618801-961b-404b-b5b4-f52de72c1368 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:24.126742 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0d618801-961b-404b-b5b4-f52de72c1368 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:24.134747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0d618801-961b-404b-b5b4-f52de72c1368 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.167478 May 18 17:08:24.135316 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 180/347] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:23 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:25.123936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-e5ca96ad-9587-46fa-95cf-bb588fc48e18 req-ff35ebae-05e6-4711-bb7c-3d61fe798118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9559237-c858-41a6-ba99-09106ba78496", "tag": "a59f32ad-7870-4083-b0d4-262a85cedd52"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:25.132150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e5ca96ad-9587-46fa-95cf-bb588fc48e18 req-ff35ebae-05e6-4711-bb7c-3d61fe798118 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:25.132814 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e5ca96ad-9587-46fa-95cf-bb588fc48e18 req-ff35ebae-05e6-4711-bb7c-3d61fe798118 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:25.144632 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-e5ca96ad-9587-46fa-95cf-bb588fc48e18 req-ff35ebae-05e6-4711-bb7c-3d61fe798118 service nova] Creating event network-changed:a59f32ad-7870-4083-b0d4-262a85cedd52 for instance e9559237-c858-41a6-ba99-09106ba78496 on hv-cinder-79578 May 18 17:08:25.149797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-e5ca96ad-9587-46fa-95cf-bb588fc48e18 req-ff35ebae-05e6-4711-bb7c-3d61fe798118 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030089 May 18 17:08:25.150728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 168/348] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:08:25.152812 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d2ffa00e-ea52-4771-9c80-de5aeeed2374 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:25.153348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d2ffa00e-ea52-4771-9c80-de5aeeed2374 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:25.160102 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2ffa00e-ea52-4771-9c80-de5aeeed2374 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:25.160666 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2ffa00e-ea52-4771-9c80-de5aeeed2374 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:25.161352 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2ffa00e-ea52-4771-9c80-de5aeeed2374 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:25.161807 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d2ffa00e-ea52-4771-9c80-de5aeeed2374 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:25.302522 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d2ffa00e-ea52-4771-9c80-de5aeeed2374 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:25.316705 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d2ffa00e-ea52-4771-9c80-de5aeeed2374 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.168231 May 18 17:08:25.317589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 181/349] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:25 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:08:26.334840 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0fe1e264-ce3d-4339-8438-96be9093bdb4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:26.335535 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0fe1e264-ce3d-4339-8438-96be9093bdb4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:26.342060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0fe1e264-ce3d-4339-8438-96be9093bdb4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:26.342510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0fe1e264-ce3d-4339-8438-96be9093bdb4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:26.344155 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0fe1e264-ce3d-4339-8438-96be9093bdb4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:26.344596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0fe1e264-ce3d-4339-8438-96be9093bdb4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:26.482645 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0fe1e264-ce3d-4339-8438-96be9093bdb4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:26.491744 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0fe1e264-ce3d-4339-8438-96be9093bdb4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.161602 May 18 17:08:26.492353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 169/350] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:26 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:27.508719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-32a62537-8dff-4f5e-b53c-d4af4986fcac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:27.509337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-32a62537-8dff-4f5e-b53c-d4af4986fcac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:27.515805 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32a62537-8dff-4f5e-b53c-d4af4986fcac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:27.516303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32a62537-8dff-4f5e-b53c-d4af4986fcac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:27.517108 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32a62537-8dff-4f5e-b53c-d4af4986fcac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:27.517536 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32a62537-8dff-4f5e-b53c-d4af4986fcac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:27.652563 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-32a62537-8dff-4f5e-b53c-d4af4986fcac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:27.660921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-32a62537-8dff-4f5e-b53c-d4af4986fcac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.155860 May 18 17:08:27.661611 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 182/351] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:27 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:28.678491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3430a4c4-5347-490a-b41e-d0ac1adc999e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:28.679185 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3430a4c4-5347-490a-b41e-d0ac1adc999e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:28.685916 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3430a4c4-5347-490a-b41e-d0ac1adc999e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:28.687189 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3430a4c4-5347-490a-b41e-d0ac1adc999e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:28.688190 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3430a4c4-5347-490a-b41e-d0ac1adc999e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:28.688519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3430a4c4-5347-490a-b41e-d0ac1adc999e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:28.873774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3430a4c4-5347-490a-b41e-d0ac1adc999e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:28.882765 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3430a4c4-5347-490a-b41e-d0ac1adc999e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.208421 May 18 17:08:28.883361 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 170/352] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:28 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:29.604262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-333116651", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-623668497", "security_groups": [{"name": "tempest-secgroup-smoke-176389902"}], "networks": [{"uuid": "38b6fed9-0bd5-4d7d-8f89-c221388eb741"}], "block_device_mapping_v2": [{"uuid": "15e3616a-2c04-456f-90a1-592d3b55055b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:29.721634 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] validate_networks() for [('38b6fed9-0bd5-4d7d-8f89-c221388eb741', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:08:29.900859 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fae0739d-2620-4d17-a38a-3fc4e4b11d10 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:29.901469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fae0739d-2620-4d17-a38a-3fc4e4b11d10 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:29.912734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fae0739d-2620-4d17-a38a-3fc4e4b11d10 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:29.913183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fae0739d-2620-4d17-a38a-3fc4e4b11d10 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:29.914034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fae0739d-2620-4d17-a38a-3fc4e4b11d10 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:29.914468 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fae0739d-2620-4d17-a38a-3fc4e4b11d10 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:30.090486 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fae0739d-2620-4d17-a38a-3fc4e4b11d10 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:30.099203 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fae0739d-2620-4d17-a38a-3fc4e4b11d10 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.202668 May 18 17:08:30.100195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 171/353] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:29 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:30.126443 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:08:30.127118 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:08:30.127755 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:08:30.128147 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:08:30.128700 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:08:30.138582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:30.139031 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:30.140766 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:30.141227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:30.161017 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Getting quotas for project 10568aeb4aba423585e0668a4a5e05d9. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:08:30.165207 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Getting quotas for user edf6a4f02eb34720b0126d17db1c1b86 and project 10568aeb4aba423585e0668a4a5e05d9. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:08:30.227220 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:08:30.229333 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15e3616a-2c04-456f-90a1-592d3b55055b',volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:08:30.371488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1e5a6a54-4de5-4ac1-9751-b6e9c77967eb tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.770984 May 18 17:08:30.372130 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 183/354] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:08:29 2022] POST /compute/v2.1/servers => generated 405 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:08:30.382417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-80706691-733c-4dbd-9939-66e1c548a735 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:30.383020 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-80706691-733c-4dbd-9939-66e1c548a735 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:30.445051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-80706691-733c-4dbd-9939-66e1c548a735 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:30.453768 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-80706691-733c-4dbd-9939-66e1c548a735 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1087 microversion: 2.1 time: 0.074990 May 18 17:08:30.454644 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 172/355] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:30 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1087 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:31.117490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-eed0d7c8-0517-4233-a46a-8c9c3f0cf268 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:31.118282 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-eed0d7c8-0517-4233-a46a-8c9c3f0cf268 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:31.126422 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eed0d7c8-0517-4233-a46a-8c9c3f0cf268 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:31.127004 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eed0d7c8-0517-4233-a46a-8c9c3f0cf268 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:31.127797 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eed0d7c8-0517-4233-a46a-8c9c3f0cf268 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:31.128243 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-eed0d7c8-0517-4233-a46a-8c9c3f0cf268 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:31.132460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=100 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:31.270966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-eed0d7c8-0517-4233-a46a-8c9c3f0cf268 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:31.278493 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-eed0d7c8-0517-4233-a46a-8c9c3f0cf268 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.164942 May 18 17:08:31.279059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 184/356] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:31 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:31.471107 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f28979fe-2c8b-41f4-9400-2158f0107a75 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:31.471989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f28979fe-2c8b-41f4-9400-2158f0107a75 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:31.478862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f28979fe-2c8b-41f4-9400-2158f0107a75 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:31.479385 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f28979fe-2c8b-41f4-9400-2158f0107a75 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:31.480324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f28979fe-2c8b-41f4-9400-2158f0107a75 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:31.489830 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f28979fe-2c8b-41f4-9400-2158f0107a75 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:31.607344 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f28979fe-2c8b-41f4-9400-2158f0107a75 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:31.618405 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f28979fe-2c8b-41f4-9400-2158f0107a75 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1129 microversion: 2.1 time: 0.151415 May 18 17:08:31.619391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 173/357] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:31 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1129 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:32.295836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-197d6aa0-09d7-44c2-a378-1969786f9ebd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:32.296458 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-197d6aa0-09d7-44c2-a378-1969786f9ebd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:32.303503 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-197d6aa0-09d7-44c2-a378-1969786f9ebd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:32.304033 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-197d6aa0-09d7-44c2-a378-1969786f9ebd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:32.305078 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-197d6aa0-09d7-44c2-a378-1969786f9ebd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:32.305581 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-197d6aa0-09d7-44c2-a378-1969786f9ebd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:32.434285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-197d6aa0-09d7-44c2-a378-1969786f9ebd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:32.442607 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-197d6aa0-09d7-44c2-a378-1969786f9ebd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.150651 May 18 17:08:32.443179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 185/358] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:32 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:32.636622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-73a917eb-3c47-4d97-aacd-fc2d142891f8 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:32.637165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-73a917eb-3c47-4d97-aacd-fc2d142891f8 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:32.644774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-73a917eb-3c47-4d97-aacd-fc2d142891f8 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:32.645222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-73a917eb-3c47-4d97-aacd-fc2d142891f8 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:32.646021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-73a917eb-3c47-4d97-aacd-fc2d142891f8 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:32.646466 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-73a917eb-3c47-4d97-aacd-fc2d142891f8 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:32.709596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-73a917eb-3c47-4d97-aacd-fc2d142891f8 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:32.718338 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-73a917eb-3c47-4d97-aacd-fc2d142891f8 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1185 microversion: 2.1 time: 0.085513 May 18 17:08:32.718922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 174/359] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:32 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:33.459466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-373398dd-fff0-453a-84ab-ad089adb7ce1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:33.460072 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-373398dd-fff0-453a-84ab-ad089adb7ce1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:33.468127 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-373398dd-fff0-453a-84ab-ad089adb7ce1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:33.468742 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-373398dd-fff0-453a-84ab-ad089adb7ce1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:33.469606 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-373398dd-fff0-453a-84ab-ad089adb7ce1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:33.470203 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-373398dd-fff0-453a-84ab-ad089adb7ce1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:33.615115 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-373398dd-fff0-453a-84ab-ad089adb7ce1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:33.623137 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-373398dd-fff0-453a-84ab-ad089adb7ce1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.167371 May 18 17:08:33.626296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 186/360] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:33 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:33.745897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a734a4d0-5668-428b-bb84-086e739cf7ad tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:33.758721 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a734a4d0-5668-428b-bb84-086e739cf7ad tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:33.781339 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a734a4d0-5668-428b-bb84-086e739cf7ad tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:33.783822 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a734a4d0-5668-428b-bb84-086e739cf7ad tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:33.785796 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a734a4d0-5668-428b-bb84-086e739cf7ad tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:33.786680 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a734a4d0-5668-428b-bb84-086e739cf7ad tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:33.942659 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a734a4d0-5668-428b-bb84-086e739cf7ad tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:33.950447 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a734a4d0-5668-428b-bb84-086e739cf7ad tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1270 microversion: 2.1 time: 0.218486 May 18 17:08:33.951305 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 175/361] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:33 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1270 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:08:34.631798 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-c6570d96-3902-4b71-b7fa-233309dc72a5 req-da8dd2f7-fd84-44ff-b8ff-a07687eb26c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee", "tag": "cac676f2-4e76-4013-9947-99f06f080ac2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:34.643827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0bd88366-5a69-4722-9b97-61779f24aa50 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:34.644705 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0bd88366-5a69-4722-9b97-61779f24aa50 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:34.651755 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bd88366-5a69-4722-9b97-61779f24aa50 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.652560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bd88366-5a69-4722-9b97-61779f24aa50 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:34.653481 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bd88366-5a69-4722-9b97-61779f24aa50 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.654080 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bd88366-5a69-4722-9b97-61779f24aa50 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:34.659120 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c6570d96-3902-4b71-b7fa-233309dc72a5 req-da8dd2f7-fd84-44ff-b8ff-a07687eb26c7 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.659573 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c6570d96-3902-4b71-b7fa-233309dc72a5 req-da8dd2f7-fd84-44ff-b8ff-a07687eb26c7 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:34.687994 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-c6570d96-3902-4b71-b7fa-233309dc72a5 req-da8dd2f7-fd84-44ff-b8ff-a07687eb26c7 service nova] Creating event network-changed:cac676f2-4e76-4013-9947-99f06f080ac2 for instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee on hv-cinder-79578 May 18 17:08:34.694723 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-c6570d96-3902-4b71-b7fa-233309dc72a5 req-da8dd2f7-fd84-44ff-b8ff-a07687eb26c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066080 May 18 17:08:34.696177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 187/362] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:08:34.904840 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0bd88366-5a69-4722-9b97-61779f24aa50 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:34.914930 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0bd88366-5a69-4722-9b97-61779f24aa50 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1503 microversion: 2.1 time: 0.278450 May 18 17:08:34.915502 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 176/363] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:34 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1503 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:34.932879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0c569c0-b3be-477c-9725-8c4adf718987"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:34.934166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:34.941753 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.942203 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:34.943054 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.943627 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:34.969426 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9d2d752e-b22a-484d-aace-204574b2da93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:34.970248 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9d2d752e-b22a-484d-aace-204574b2da93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:34.972504 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] HTTP exception thrown: Cannot 'attach_volume' instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 while it is in vm_state rescued May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Request method failure captured: May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: POST /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699/os-volume_attachments HTTP/1.1 May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 74 May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd7mhZqsvU-pGf7jhqBpZwoFEOMD7ZgntriICrKuuArePuDRkM58WnyFUIbPMb6g9J-eLPYfmczvVnkU2koaO0drl2hFLltVrrisVCkxp8Il7eqoibvrfNlsnqG5atcXRhjgVIjaLVxdAxtFvtgzQ8XDIuoZV8Tlq_cEpRqksjRaYo May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:08:34.975210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 5e28c0ca22d143eebe6fc93f85442a7f May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {"volumeAttachment": {"volumeId": "b0c569c0-b3be-477c-9725-8c4adf718987"}} May 18 17:08:34.976787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Cannot 'attach_volume' instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 while it is in vm_state rescued May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'server_id': '8a1e5ac3-2af5-4bee-a830-1f6014618699', 'body': {'volumeAttachment': {'volumeId': 'b0c569c0-b3be-477c-9725-8c4adf718987'}}} May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:08:34.977876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 while it is in vm_state rescued May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:08:34.979491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:08:34.980842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:08:34.980842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:08:34.980842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 while it is in vm_state rescued May 18 17:08:34.980842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:08:34.980842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Returning 409 to user: Cannot 'attach_volume' instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 while it is in vm_state rescued {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:08:34.980842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-17911e87-e788-40c4-a872-2f7428398c91 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048935 May 18 17:08:34.980842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 188/364] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:08:34 2022] POST /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 18 17:08:34.982850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d2d752e-b22a-484d-aace-204574b2da93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.984054 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d2d752e-b22a-484d-aace-204574b2da93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:34.984763 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d2d752e-b22a-484d-aace-204574b2da93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.985262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d2d752e-b22a-484d-aace-204574b2da93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:34.987054 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a6f4cd77-5763-4f74-b028-96041576ec45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:34.987600 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a6f4cd77-5763-4f74-b028-96041576ec45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:34.994566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6f4cd77-5763-4f74-b028-96041576ec45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.995171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6f4cd77-5763-4f74-b028-96041576ec45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:34.995960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6f4cd77-5763-4f74-b028-96041576ec45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:34.996403 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6f4cd77-5763-4f74-b028-96041576ec45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:35.001577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:35.085405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a6f4cd77-5763-4f74-b028-96041576ec45 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699/action" status: 202 len: 0 microversion: 2.1 time: 0.102439 May 18 17:08:35.086101 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 189/365] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:08:34 2022] POST /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:08:35.098011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d5a2efb5-4b2a-4041-83d1-d8d94f8df0b0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:35.099405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d5a2efb5-4b2a-4041-83d1-d8d94f8df0b0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:35.111357 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d5a2efb5-4b2a-4041-83d1-d8d94f8df0b0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:35.111836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d5a2efb5-4b2a-4041-83d1-d8d94f8df0b0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:35.112626 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d5a2efb5-4b2a-4041-83d1-d8d94f8df0b0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:35.113074 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d5a2efb5-4b2a-4041-83d1-d8d94f8df0b0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:35.365645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d5a2efb5-4b2a-4041-83d1-d8d94f8df0b0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:35.377955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d5a2efb5-4b2a-4041-83d1-d8d94f8df0b0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1511 microversion: 2.1 time: 0.285447 May 18 17:08:35.379234 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 190/366] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:35 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:35.449469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9d2d752e-b22a-484d-aace-204574b2da93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:35.458440 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9d2d752e-b22a-484d-aace-204574b2da93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.493655 May 18 17:08:35.459246 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 177/367] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:34 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:36.396676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1abee00e-532c-4db7-93ea-8a352c7dccb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:36.397289 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1abee00e-532c-4db7-93ea-8a352c7dccb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:36.403365 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1abee00e-532c-4db7-93ea-8a352c7dccb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:36.403820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1abee00e-532c-4db7-93ea-8a352c7dccb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:36.404586 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1abee00e-532c-4db7-93ea-8a352c7dccb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:36.405028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1abee00e-532c-4db7-93ea-8a352c7dccb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:36.476299 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0d7d6352-6a60-47a6-892d-1d7d398423b2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:36.476903 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0d7d6352-6a60-47a6-892d-1d7d398423b2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:36.483932 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0d7d6352-6a60-47a6-892d-1d7d398423b2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:36.484395 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0d7d6352-6a60-47a6-892d-1d7d398423b2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:36.485176 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0d7d6352-6a60-47a6-892d-1d7d398423b2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:36.485591 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0d7d6352-6a60-47a6-892d-1d7d398423b2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:36.545565 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1abee00e-532c-4db7-93ea-8a352c7dccb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:36.554363 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1abee00e-532c-4db7-93ea-8a352c7dccb6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1511 microversion: 2.1 time: 0.162452 May 18 17:08:36.554938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 191/368] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:36 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:36.623648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0d7d6352-6a60-47a6-892d-1d7d398423b2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:36.631793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0d7d6352-6a60-47a6-892d-1d7d398423b2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.159384 May 18 17:08:36.632348 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 178/369] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:36 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:08:37.574368 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d407f142-7365-42a1-a1ab-812e724a7f9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:37.574974 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d407f142-7365-42a1-a1ab-812e724a7f9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:37.581810 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d407f142-7365-42a1-a1ab-812e724a7f9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:37.582263 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d407f142-7365-42a1-a1ab-812e724a7f9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:37.583040 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d407f142-7365-42a1-a1ab-812e724a7f9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:37.583506 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d407f142-7365-42a1-a1ab-812e724a7f9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:37.650009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b3adff10-8711-4b03-8d61-abfd54583a01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:37.650603 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b3adff10-8711-4b03-8d61-abfd54583a01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:37.658655 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b3adff10-8711-4b03-8d61-abfd54583a01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:37.659208 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b3adff10-8711-4b03-8d61-abfd54583a01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:37.660015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b3adff10-8711-4b03-8d61-abfd54583a01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:37.660532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b3adff10-8711-4b03-8d61-abfd54583a01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:37.724692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d407f142-7365-42a1-a1ab-812e724a7f9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:37.732596 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d407f142-7365-42a1-a1ab-812e724a7f9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1511 microversion: 2.1 time: 0.162056 May 18 17:08:37.733832 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 192/370] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:37 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:08:37.896415 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b3adff10-8711-4b03-8d61-abfd54583a01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:37.904041 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b3adff10-8711-4b03-8d61-abfd54583a01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.259455 May 18 17:08:37.904741 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 179/371] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:37 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:08:38.749628 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-45e30dbc-ee71-4d2e-9bd2-2f8c9d0856a2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:38.750251 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-45e30dbc-ee71-4d2e-9bd2-2f8c9d0856a2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:38.752218 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:38.757557 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45e30dbc-ee71-4d2e-9bd2-2f8c9d0856a2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:38.758485 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45e30dbc-ee71-4d2e-9bd2-2f8c9d0856a2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:38.758864 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45e30dbc-ee71-4d2e-9bd2-2f8c9d0856a2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:38.759296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45e30dbc-ee71-4d2e-9bd2-2f8c9d0856a2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:38.893062 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-45e30dbc-ee71-4d2e-9bd2-2f8c9d0856a2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:38.900583 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-45e30dbc-ee71-4d2e-9bd2-2f8c9d0856a2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1511 microversion: 2.1 time: 0.154755 May 18 17:08:38.901152 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 193/372] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:38 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:38.922123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b4ab1005-7279-4e95-894b-8fea2ee50a74 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:38.922873 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b4ab1005-7279-4e95-894b-8fea2ee50a74 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:38.929238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4ab1005-7279-4e95-894b-8fea2ee50a74 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:38.929720 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4ab1005-7279-4e95-894b-8fea2ee50a74 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:38.930485 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4ab1005-7279-4e95-894b-8fea2ee50a74 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:38.930923 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4ab1005-7279-4e95-894b-8fea2ee50a74 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:39.062779 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4ab1005-7279-4e95-894b-8fea2ee50a74 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:39.070277 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b4ab1005-7279-4e95-894b-8fea2ee50a74 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.151965 May 18 17:08:39.070841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 180/373] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:38 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:39.918538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e00691e7-1840-4354-a5c2-9360a7c9a024 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:39.919185 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e00691e7-1840-4354-a5c2-9360a7c9a024 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:39.925825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e00691e7-1840-4354-a5c2-9360a7c9a024 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:39.926282 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e00691e7-1840-4354-a5c2-9360a7c9a024 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:39.927052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e00691e7-1840-4354-a5c2-9360a7c9a024 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:39.927492 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e00691e7-1840-4354-a5c2-9360a7c9a024 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:40.055222 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e00691e7-1840-4354-a5c2-9360a7c9a024 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:40.063557 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e00691e7-1840-4354-a5c2-9360a7c9a024 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1511 microversion: 2.1 time: 0.148798 May 18 17:08:40.064141 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 194/374] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:39 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:40.087093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e3287673-c35f-4663-a2ef-38a0736dc159 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:40.087702 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e3287673-c35f-4663-a2ef-38a0736dc159 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:40.095308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3287673-c35f-4663-a2ef-38a0736dc159 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:40.095756 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3287673-c35f-4663-a2ef-38a0736dc159 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:40.096512 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3287673-c35f-4663-a2ef-38a0736dc159 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:40.096946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e3287673-c35f-4663-a2ef-38a0736dc159 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:40.230903 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e3287673-c35f-4663-a2ef-38a0736dc159 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:40.238966 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e3287673-c35f-4663-a2ef-38a0736dc159 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.155677 May 18 17:08:40.239541 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 181/375] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:40 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:41.080842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2a3b71b3-fb67-420b-a34f-efd4c4b4a996 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:41.081461 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2a3b71b3-fb67-420b-a34f-efd4c4b4a996 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:41.083379 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:41.084043 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:41.090005 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2a3b71b3-fb67-420b-a34f-efd4c4b4a996 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:41.090459 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2a3b71b3-fb67-420b-a34f-efd4c4b4a996 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:41.091227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2a3b71b3-fb67-420b-a34f-efd4c4b4a996 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:41.091673 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2a3b71b3-fb67-420b-a34f-efd4c4b4a996 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:41.237923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2a3b71b3-fb67-420b-a34f-efd4c4b4a996 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:41.245453 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2a3b71b3-fb67-420b-a34f-efd4c4b4a996 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1511 microversion: 2.1 time: 0.168989 May 18 17:08:41.246048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 195/376] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:41 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:41.255788 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f4def270-c338-45a5-8c40-7e335d4c9dc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:41.256408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f4def270-c338-45a5-8c40-7e335d4c9dc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:41.258225 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:41.264025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f4def270-c338-45a5-8c40-7e335d4c9dc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:41.264509 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f4def270-c338-45a5-8c40-7e335d4c9dc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:41.265811 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f4def270-c338-45a5-8c40-7e335d4c9dc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:41.266241 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f4def270-c338-45a5-8c40-7e335d4c9dc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:41.403528 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f4def270-c338-45a5-8c40-7e335d4c9dc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:41.411699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f4def270-c338-45a5-8c40-7e335d4c9dc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.159699 May 18 17:08:41.412267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 182/377] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:41 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:42.263316 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02e5cac0-5f3b-4324-960a-cdaa4ca30978 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:42.263931 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02e5cac0-5f3b-4324-960a-cdaa4ca30978 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:42.270793 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e5cac0-5f3b-4324-960a-cdaa4ca30978 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:42.271249 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e5cac0-5f3b-4324-960a-cdaa4ca30978 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:42.272015 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e5cac0-5f3b-4324-960a-cdaa4ca30978 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:42.272458 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e5cac0-5f3b-4324-960a-cdaa4ca30978 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:42.404260 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02e5cac0-5f3b-4324-960a-cdaa4ca30978 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:42.412484 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02e5cac0-5f3b-4324-960a-cdaa4ca30978 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1517 microversion: 2.1 time: 0.153102 May 18 17:08:42.413048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 196/378] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:42 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:42.429990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bb547dfa-54f2-4ed8-939e-69e3c47da6ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:42.431292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bb547dfa-54f2-4ed8-939e-69e3c47da6ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:42.437615 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb547dfa-54f2-4ed8-939e-69e3c47da6ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:42.438099 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb547dfa-54f2-4ed8-939e-69e3c47da6ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:42.438897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb547dfa-54f2-4ed8-939e-69e3c47da6ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:42.439338 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bb547dfa-54f2-4ed8-939e-69e3c47da6ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:42.573599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bb547dfa-54f2-4ed8-939e-69e3c47da6ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:42.582272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bb547dfa-54f2-4ed8-939e-69e3c47da6ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.156221 May 18 17:08:42.582953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 183/379] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:42 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:43.600044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dacbe941-aa36-46d0-af4b-afa0d8b3bf93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:43.600664 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dacbe941-aa36-46d0-af4b-afa0d8b3bf93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:43.606749 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dacbe941-aa36-46d0-af4b-afa0d8b3bf93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:43.607190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dacbe941-aa36-46d0-af4b-afa0d8b3bf93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:43.607960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dacbe941-aa36-46d0-af4b-afa0d8b3bf93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:43.608992 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dacbe941-aa36-46d0-af4b-afa0d8b3bf93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:43.744055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dacbe941-aa36-46d0-af4b-afa0d8b3bf93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:43.751688 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dacbe941-aa36-46d0-af4b-afa0d8b3bf93 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.155519 May 18 17:08:43.752249 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 197/380] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:43 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:44.769118 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c7bd26f9-1266-4ff7-abab-39a2a7f2b201 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:44.769780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c7bd26f9-1266-4ff7-abab-39a2a7f2b201 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:44.776004 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7bd26f9-1266-4ff7-abab-39a2a7f2b201 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:44.776483 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7bd26f9-1266-4ff7-abab-39a2a7f2b201 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:44.777244 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7bd26f9-1266-4ff7-abab-39a2a7f2b201 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:44.777691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7bd26f9-1266-4ff7-abab-39a2a7f2b201 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:44.802360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c02e0402-97ce-4a2e-a7dd-58a2a1a9197f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'create', calling method: .version_select at 0x7feef3d72670>, body: {"keypair": {"name": "tempest-keypair-1557598847", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoSHq8fKVH9zCEpeD0kiG8F4UepA31XEiPxiwyVqtqzKtx4H8b26cV8XJnz8zVOujPUB9Jjv2DAfd42B4l6siKLClzNJTujQtsMnpgX3VLc+7vzyQEJmU4dL3VbBLF8OA=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:44.817714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-c02e0402-97ce-4a2e-a7dd-58a2a1a9197f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Getting quotas for project af6df110a2604ba3adab104ec1decf4c. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:08:44.821976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-c02e0402-97ce-4a2e-a7dd-58a2a1a9197f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Getting quotas for user 5e28c0ca22d143eebe6fc93f85442a7f and project af6df110a2604ba3adab104ec1decf4c. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:08:44.846312 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c02e0402-97ce-4a2e-a7dd-58a2a1a9197f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047641 May 18 17:08:44.847130 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 198/381] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:08:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:08:44.962548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c7bd26f9-1266-4ff7-abab-39a2a7f2b201 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:44.971383 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c7bd26f9-1266-4ff7-abab-39a2a7f2b201 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.206825 May 18 17:08:44.971971 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 184/382] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:44 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:45.989035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3275d493-bff9-473b-8658-eae8661b728e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:45.989674 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3275d493-bff9-473b-8658-eae8661b728e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:45.995687 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3275d493-bff9-473b-8658-eae8661b728e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:45.996138 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3275d493-bff9-473b-8658-eae8661b728e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:45.996905 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3275d493-bff9-473b-8658-eae8661b728e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:45.997343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3275d493-bff9-473b-8658-eae8661b728e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:46.214825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3275d493-bff9-473b-8658-eae8661b728e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:46.232110 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3275d493-bff9-473b-8658-eae8661b728e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.246904 May 18 17:08:46.232956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 199/383] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:45 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:08:46.319074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1819102267", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9c70e49-a6c9-4da7-a148-eecd9a6e2924"}], "security_groups": [{"name": "tempest-securitygroup--1489790869"}], "key_name": "tempest-keypair-1557598847", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:46.428487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] validate_networks() for [('f9c70e49-a6c9-4da7-a148-eecd9a6e2924', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:08:46.932234 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:08:46.932689 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:08:46.933323 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:08:46.933772 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:08:46.934211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:08:46.943896 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:46.944344 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:46.945147 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:46.945587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:46.963268 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Getting quotas for project af6df110a2604ba3adab104ec1decf4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:08:46.967398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Getting quotas for user 5e28c0ca22d143eebe6fc93f85442a7f and project af6df110a2604ba3adab104ec1decf4c. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:08:46.978640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:08:46.980889 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:08:47.029179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e9f5e238-c8c6-4061-8355-048c98c7df80 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.714276 May 18 17:08:47.030838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 185/384] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:08:46 2022] POST /compute/v2.1/servers => generated 409 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:08:47.039771 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-db284eb7-550d-4df6-b4df-f169a84833fa tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:47.040389 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-db284eb7-550d-4df6-b4df-f169a84833fa tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:47.115615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-db284eb7-550d-4df6-b4df-f169a84833fa tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:47.123391 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-db284eb7-550d-4df6-b4df-f169a84833fa tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1246 microversion: 2.1 time: 0.087414 May 18 17:08:47.124322 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 200/385] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:47 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:47.250621 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-81f2e36b-91e2-4b22-bbd9-9bf3a4a364c1 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:47.251309 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-81f2e36b-91e2-4b22-bbd9-9bf3a4a364c1 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:47.257729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-81f2e36b-91e2-4b22-bbd9-9bf3a4a364c1 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:47.258180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-81f2e36b-91e2-4b22-bbd9-9bf3a4a364c1 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:47.258948 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-81f2e36b-91e2-4b22-bbd9-9bf3a4a364c1 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:47.259558 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-81f2e36b-91e2-4b22-bbd9-9bf3a4a364c1 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:47.435672 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-81f2e36b-91e2-4b22-bbd9-9bf3a4a364c1 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:47.445589 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-81f2e36b-91e2-4b22-bbd9-9bf3a4a364c1 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.199530 May 18 17:08:47.446214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 186/386] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:47 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:48.141718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0682935b-fa59-4ec2-88f0-718184145298 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:48.142578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0682935b-fa59-4ec2-88f0-718184145298 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:48.149306 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0682935b-fa59-4ec2-88f0-718184145298 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:48.149961 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-a34d8ced-34bf-4abe-b43b-6ff8025fd73a req-2aa7641c-e82b-428b-bfa5-cde247004f90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee", "name": "network-vif-plugged", "status": "completed", "tag": "cac676f2-4e76-4013-9947-99f06f080ac2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:48.150301 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0682935b-fa59-4ec2-88f0-718184145298 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:48.150495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0682935b-fa59-4ec2-88f0-718184145298 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:48.151103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0682935b-fa59-4ec2-88f0-718184145298 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:48.166050 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-a34d8ced-34bf-4abe-b43b-6ff8025fd73a req-2aa7641c-e82b-428b-bfa5-cde247004f90 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:48.167380 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-a34d8ced-34bf-4abe-b43b-6ff8025fd73a req-2aa7641c-e82b-428b-bfa5-cde247004f90 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:48.209504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-a34d8ced-34bf-4abe-b43b-6ff8025fd73a req-2aa7641c-e82b-428b-bfa5-cde247004f90 service nova] Creating event network-vif-plugged:cac676f2-4e76-4013-9947-99f06f080ac2 for instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee on hv-cinder-79578 May 18 17:08:48.215729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-a34d8ced-34bf-4abe-b43b-6ff8025fd73a req-2aa7641c-e82b-428b-bfa5-cde247004f90 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073642 May 18 17:08:48.217067 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 187/387] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:08:48.226960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0682935b-fa59-4ec2-88f0-718184145298 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:48.235204 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0682935b-fa59-4ec2-88f0-718184145298 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1306 microversion: 2.1 time: 0.098431 May 18 17:08:48.236955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 201/388] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:48 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1306 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:48.469147 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-57e09c04-aeb2-45de-9916-d7fbc0452186 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:48.470362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-57e09c04-aeb2-45de-9916-d7fbc0452186 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:48.481179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-57e09c04-aeb2-45de-9916-d7fbc0452186 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:48.481978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-57e09c04-aeb2-45de-9916-d7fbc0452186 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:48.484159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-57e09c04-aeb2-45de-9916-d7fbc0452186 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:48.485156 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-57e09c04-aeb2-45de-9916-d7fbc0452186 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:48.704395 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-57e09c04-aeb2-45de-9916-d7fbc0452186 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:48.714775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-57e09c04-aeb2-45de-9916-d7fbc0452186 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.253582 May 18 17:08:48.716006 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 188/389] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:48 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:49.253929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-87e2e89c-2959-43aa-8eb2-1595bdcabf17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:49.254546 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-87e2e89c-2959-43aa-8eb2-1595bdcabf17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:49.261250 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87e2e89c-2959-43aa-8eb2-1595bdcabf17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:49.261719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87e2e89c-2959-43aa-8eb2-1595bdcabf17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:49.262496 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87e2e89c-2959-43aa-8eb2-1595bdcabf17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:49.262938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87e2e89c-2959-43aa-8eb2-1595bdcabf17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:49.397724 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-87e2e89c-2959-43aa-8eb2-1595bdcabf17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:49.400054 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:49.407457 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-87e2e89c-2959-43aa-8eb2-1595bdcabf17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.157398 May 18 17:08:49.408135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 202/390] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:49 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:49.735421 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4ed7a620-6799-4337-84c9-df78417bd51f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:49.736130 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4ed7a620-6799-4337-84c9-df78417bd51f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:49.738757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:49.744770 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed7a620-6799-4337-84c9-df78417bd51f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:49.745769 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed7a620-6799-4337-84c9-df78417bd51f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:49.746284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed7a620-6799-4337-84c9-df78417bd51f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:49.746839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ed7a620-6799-4337-84c9-df78417bd51f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:49.940659 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-eaae44ec-e067-4b3d-a82b-be836ffd5971 req-6f7a3577-83f4-4eb4-90f8-9736330d9ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547563fc-2b40-4782-be59-1e1dfcbae2e9", "tag": "97903cf8-6adc-4750-9dcb-7e5cd03b095f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:49.950371 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-eaae44ec-e067-4b3d-a82b-be836ffd5971 req-6f7a3577-83f4-4eb4-90f8-9736330d9ce4 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:49.950851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-eaae44ec-e067-4b3d-a82b-be836ffd5971 req-6f7a3577-83f4-4eb4-90f8-9736330d9ce4 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:49.966023 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-eaae44ec-e067-4b3d-a82b-be836ffd5971 req-6f7a3577-83f4-4eb4-90f8-9736330d9ce4 service nova] Creating event network-changed:97903cf8-6adc-4750-9dcb-7e5cd03b095f for instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 on hv-cinder-79578 May 18 17:08:49.972176 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-eaae44ec-e067-4b3d-a82b-be836ffd5971 req-6f7a3577-83f4-4eb4-90f8-9736330d9ce4 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035422 May 18 17:08:49.972785 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 203/391] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:08:49.989583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ed7a620-6799-4337-84c9-df78417bd51f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:49.998070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4ed7a620-6799-4337-84c9-df78417bd51f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1258 microversion: 2.1 time: 0.269424 May 18 17:08:49.999018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 189/392] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:49 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1258 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:50.426031 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-720b3a3e-418c-4cf7-9a39-7c5ba90b4776 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:50.426681 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-720b3a3e-418c-4cf7-9a39-7c5ba90b4776 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:50.433082 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-720b3a3e-418c-4cf7-9a39-7c5ba90b4776 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:50.433531 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-720b3a3e-418c-4cf7-9a39-7c5ba90b4776 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:50.434325 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-720b3a3e-418c-4cf7-9a39-7c5ba90b4776 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:50.434766 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-720b3a3e-418c-4cf7-9a39-7c5ba90b4776 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:50.575906 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-720b3a3e-418c-4cf7-9a39-7c5ba90b4776 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:50.583649 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-720b3a3e-418c-4cf7-9a39-7c5ba90b4776 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.163067 May 18 17:08:50.584216 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 204/393] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:50 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:51.015061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b2b8a677-70b6-46c7-b175-3e194fd24376 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:51.015616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b2b8a677-70b6-46c7-b175-3e194fd24376 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:51.022180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b2b8a677-70b6-46c7-b175-3e194fd24376 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:51.022649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b2b8a677-70b6-46c7-b175-3e194fd24376 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:51.023395 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b2b8a677-70b6-46c7-b175-3e194fd24376 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:51.023833 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b2b8a677-70b6-46c7-b175-3e194fd24376 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:51.153801 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b2b8a677-70b6-46c7-b175-3e194fd24376 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:51.162725 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b2b8a677-70b6-46c7-b175-3e194fd24376 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1443 microversion: 2.1 time: 0.152010 May 18 17:08:51.163296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 190/394] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:51 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1443 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:51.179864 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-066224e1-28a3-40c9-b2c4-372547089b2b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:51.180481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-066224e1-28a3-40c9-b2c4-372547089b2b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:51.187615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-066224e1-28a3-40c9-b2c4-372547089b2b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:51.188079 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-066224e1-28a3-40c9-b2c4-372547089b2b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:51.188851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-066224e1-28a3-40c9-b2c4-372547089b2b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:51.189296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-066224e1-28a3-40c9-b2c4-372547089b2b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:51.320995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-066224e1-28a3-40c9-b2c4-372547089b2b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:51.328698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-066224e1-28a3-40c9-b2c4-372547089b2b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1443 microversion: 2.1 time: 0.152683 May 18 17:08:51.329268 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 205/395] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:51 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:51.600885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5201afc0-7129-48c6-90a6-ac20710d33af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:51.601499 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5201afc0-7129-48c6-90a6-ac20710d33af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:51.607717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5201afc0-7129-48c6-90a6-ac20710d33af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:51.608218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5201afc0-7129-48c6-90a6-ac20710d33af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:51.609302 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5201afc0-7129-48c6-90a6-ac20710d33af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:51.609768 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5201afc0-7129-48c6-90a6-ac20710d33af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:51.847527 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5201afc0-7129-48c6-90a6-ac20710d33af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:51.862046 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5201afc0-7129-48c6-90a6-ac20710d33af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.264583 May 18 17:08:51.863108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 191/396] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:51 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:52.878800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b2fbf686-3f69-4ded-b062-7266b703d337 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:52.879445 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b2fbf686-3f69-4ded-b062-7266b703d337 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:52.885524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2fbf686-3f69-4ded-b062-7266b703d337 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:52.886011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2fbf686-3f69-4ded-b062-7266b703d337 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:52.886786 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2fbf686-3f69-4ded-b062-7266b703d337 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:52.887238 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b2fbf686-3f69-4ded-b062-7266b703d337 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:53.023109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b2fbf686-3f69-4ded-b062-7266b703d337 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:53.031580 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b2fbf686-3f69-4ded-b062-7266b703d337 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.156678 May 18 17:08:53.032159 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 206/397] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:52 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:53.449530 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-19e73377-c996-4487-82e0-e1ef7738e224 req-906cecf6-4b21-4421-b8bf-5e12e2b5b9fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee", "tag": "cac676f2-4e76-4013-9947-99f06f080ac2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:53.458658 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-19e73377-c996-4487-82e0-e1ef7738e224 req-906cecf6-4b21-4421-b8bf-5e12e2b5b9fc service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:53.459094 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-19e73377-c996-4487-82e0-e1ef7738e224 req-906cecf6-4b21-4421-b8bf-5e12e2b5b9fc service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:53.471642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-19e73377-c996-4487-82e0-e1ef7738e224 req-906cecf6-4b21-4421-b8bf-5e12e2b5b9fc service nova] Creating event network-changed:cac676f2-4e76-4013-9947-99f06f080ac2 for instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee on hv-cinder-79578 May 18 17:08:53.477673 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-19e73377-c996-4487-82e0-e1ef7738e224 req-906cecf6-4b21-4421-b8bf-5e12e2b5b9fc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031680 May 18 17:08:53.478272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 192/398] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:08:54.049406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c43b3531-b250-44b9-8483-165ace32b0e3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:54.049953 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c43b3531-b250-44b9-8483-165ace32b0e3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:54.056005 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c43b3531-b250-44b9-8483-165ace32b0e3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:54.056459 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c43b3531-b250-44b9-8483-165ace32b0e3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:54.057223 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c43b3531-b250-44b9-8483-165ace32b0e3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:54.057698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c43b3531-b250-44b9-8483-165ace32b0e3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:54.193945 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c43b3531-b250-44b9-8483-165ace32b0e3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:54.201635 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c43b3531-b250-44b9-8483-165ace32b0e3 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.156965 May 18 17:08:54.202550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 207/399] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:54 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:55.220759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0a18c870-8fb2-4099-8dd3-37bf90c3556f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:55.221549 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0a18c870-8fb2-4099-8dd3-37bf90c3556f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:55.227946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a18c870-8fb2-4099-8dd3-37bf90c3556f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:55.228399 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a18c870-8fb2-4099-8dd3-37bf90c3556f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:55.229172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a18c870-8fb2-4099-8dd3-37bf90c3556f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:55.229613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a18c870-8fb2-4099-8dd3-37bf90c3556f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:55.369628 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0a18c870-8fb2-4099-8dd3-37bf90c3556f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:55.378292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0a18c870-8fb2-4099-8dd3-37bf90c3556f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.162477 May 18 17:08:55.378863 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 193/400] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:55 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:56.396509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-36f6ac56-4e6d-4d5e-b544-e73a90dc8e44 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:56.397116 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-36f6ac56-4e6d-4d5e-b544-e73a90dc8e44 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:56.403695 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-36f6ac56-4e6d-4d5e-b544-e73a90dc8e44 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:56.404666 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-36f6ac56-4e6d-4d5e-b544-e73a90dc8e44 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:56.406155 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-36f6ac56-4e6d-4d5e-b544-e73a90dc8e44 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:56.406620 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-36f6ac56-4e6d-4d5e-b544-e73a90dc8e44 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:56.538496 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-36f6ac56-4e6d-4d5e-b544-e73a90dc8e44 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:56.546047 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-36f6ac56-4e6d-4d5e-b544-e73a90dc8e44 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.153502 May 18 17:08:56.546639 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 208/401] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:56 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:57.563003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cc4c5ffe-8994-4287-b57e-eeeb8804bdce tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:57.563617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cc4c5ffe-8994-4287-b57e-eeeb8804bdce tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:57.565900 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:57.566578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:57.573043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc4c5ffe-8994-4287-b57e-eeeb8804bdce tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:57.573490 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc4c5ffe-8994-4287-b57e-eeeb8804bdce tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:57.574311 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc4c5ffe-8994-4287-b57e-eeeb8804bdce tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:57.574748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cc4c5ffe-8994-4287-b57e-eeeb8804bdce tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:57.708588 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cc4c5ffe-8994-4287-b57e-eeeb8804bdce tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:57.716779 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cc4c5ffe-8994-4287-b57e-eeeb8804bdce tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.157686 May 18 17:08:57.717927 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 194/402] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:57 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:08:58.473358 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-b8ad1a76-e39b-4236-ba48-de8de6e7b433 req-93bb799f-6699-4aa0-8e4d-9c0afb17cbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547563fc-2b40-4782-be59-1e1dfcbae2e9", "name": "network-vif-plugged", "status": "completed", "tag": "97903cf8-6adc-4750-9dcb-7e5cd03b095f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:08:58.476921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:08:58.483066 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b8ad1a76-e39b-4236-ba48-de8de6e7b433 req-93bb799f-6699-4aa0-8e4d-9c0afb17cbd3 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:58.483326 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b8ad1a76-e39b-4236-ba48-de8de6e7b433 req-93bb799f-6699-4aa0-8e4d-9c0afb17cbd3 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:58.498864 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-b8ad1a76-e39b-4236-ba48-de8de6e7b433 req-93bb799f-6699-4aa0-8e4d-9c0afb17cbd3 service nova] Creating event network-vif-plugged:97903cf8-6adc-4750-9dcb-7e5cd03b095f for instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 on hv-cinder-79578 May 18 17:08:58.504176 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-b8ad1a76-e39b-4236-ba48-de8de6e7b433 req-93bb799f-6699-4aa0-8e4d-9c0afb17cbd3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034488 May 18 17:08:58.504789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 209/403] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:08:58.733495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-13e7b13b-376b-4895-8658-4abc1e3f11b1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:58.735461 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-13e7b13b-376b-4895-8658-4abc1e3f11b1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:58.741720 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-13e7b13b-376b-4895-8658-4abc1e3f11b1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:58.742183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-13e7b13b-376b-4895-8658-4abc1e3f11b1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:58.742954 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-13e7b13b-376b-4895-8658-4abc1e3f11b1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:58.743391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-13e7b13b-376b-4895-8658-4abc1e3f11b1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:58.901018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-13e7b13b-376b-4895-8658-4abc1e3f11b1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:08:58.909204 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-13e7b13b-376b-4895-8658-4abc1e3f11b1 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.179542 May 18 17:08:58.909865 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 195/404] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:58 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:08:59.926625 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-037e9697-1e34-4abb-97b5-4d004c87c544 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:08:59.927323 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-037e9697-1e34-4abb-97b5-4d004c87c544 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:08:59.933593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-037e9697-1e34-4abb-97b5-4d004c87c544 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:59.934079 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-037e9697-1e34-4abb-97b5-4d004c87c544 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:08:59.934851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-037e9697-1e34-4abb-97b5-4d004c87c544 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:08:59.935292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-037e9697-1e34-4abb-97b5-4d004c87c544 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:00.067107 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-037e9697-1e34-4abb-97b5-4d004c87c544 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:09:00.074576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-037e9697-1e34-4abb-97b5-4d004c87c544 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.152172 May 18 17:09:00.075140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 210/405] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:08:59 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:09:01.093619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ae874e1c-25a0-41fb-b80b-9d89c9666850 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:09:01.094254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ae874e1c-25a0-41fb-b80b-9d89c9666850 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:09:01.101188 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ae874e1c-25a0-41fb-b80b-9d89c9666850 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:01.101675 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ae874e1c-25a0-41fb-b80b-9d89c9666850 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:01.102462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ae874e1c-25a0-41fb-b80b-9d89c9666850 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:01.102899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ae874e1c-25a0-41fb-b80b-9d89c9666850 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:01.105593 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:09:01.242371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ae874e1c-25a0-41fb-b80b-9d89c9666850 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:09:01.250301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ae874e1c-25a0-41fb-b80b-9d89c9666850 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1372 microversion: 2.1 time: 0.161355 May 18 17:09:01.250881 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 196/406] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:09:01 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:09:02.267679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-af28ff04-ddd0-46f8-93f3-75c51f47bff8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:09:02.268318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-af28ff04-ddd0-46f8-93f3-75c51f47bff8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:09:02.274414 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-af28ff04-ddd0-46f8-93f3-75c51f47bff8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:02.274865 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-af28ff04-ddd0-46f8-93f3-75c51f47bff8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:02.275622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-af28ff04-ddd0-46f8-93f3-75c51f47bff8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:02.276055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-af28ff04-ddd0-46f8-93f3-75c51f47bff8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:02.420251 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-af28ff04-ddd0-46f8-93f3-75c51f47bff8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:09:02.429227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-af28ff04-ddd0-46f8-93f3-75c51f47bff8 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1567 microversion: 2.1 time: 0.165614 May 18 17:09:02.429839 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 211/407] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:09:02 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:09:02.446910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f592fc7c-bdd8-4838-8a2d-81ee5d468b1e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:09:02.447444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f592fc7c-bdd8-4838-8a2d-81ee5d468b1e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:09:02.454286 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f592fc7c-bdd8-4838-8a2d-81ee5d468b1e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:02.454729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f592fc7c-bdd8-4838-8a2d-81ee5d468b1e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:02.455504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f592fc7c-bdd8-4838-8a2d-81ee5d468b1e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:02.455934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f592fc7c-bdd8-4838-8a2d-81ee5d468b1e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:02.538013 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f592fc7c-bdd8-4838-8a2d-81ee5d468b1e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094947 May 18 17:09:02.538612 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 197/408] 10.222.0.49 () {58 vars in 1274 bytes} [Wed May 18 17:09:02 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:09:03.462918 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-dfbb5e07-be90-4162-a73c-fdc8d92204fd req-df8dd22c-f4a0-414e-986d-b31d155e5944 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547563fc-2b40-4782-be59-1e1dfcbae2e9", "tag": "97903cf8-6adc-4750-9dcb-7e5cd03b095f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:09:03.472517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-dfbb5e07-be90-4162-a73c-fdc8d92204fd req-df8dd22c-f4a0-414e-986d-b31d155e5944 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:03.473292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-dfbb5e07-be90-4162-a73c-fdc8d92204fd req-df8dd22c-f4a0-414e-986d-b31d155e5944 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:03.485432 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-dfbb5e07-be90-4162-a73c-fdc8d92204fd req-df8dd22c-f4a0-414e-986d-b31d155e5944 service nova] Creating event network-changed:97903cf8-6adc-4750-9dcb-7e5cd03b095f for instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 on hv-cinder-79578 May 18 17:09:03.490847 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-dfbb5e07-be90-4162-a73c-fdc8d92204fd req-df8dd22c-f4a0-414e-986d-b31d155e5944 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031369 May 18 17:09:03.491739 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 212/409] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:09:54.360964 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=17 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:09:54.361946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=9 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:09:54.367340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f64ae033-eee8-41f2-a42e-ede868826fc0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:09:54.367947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f64ae033-eee8-41f2-a42e-ede868826fc0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:09:54.375300 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f64ae033-eee8-41f2-a42e-ede868826fc0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:54.375752 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f64ae033-eee8-41f2-a42e-ede868826fc0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:54.376538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f64ae033-eee8-41f2-a42e-ede868826fc0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:54.376970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f64ae033-eee8-41f2-a42e-ede868826fc0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:54.404780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f64ae033-eee8-41f2-a42e-ede868826fc0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/ips" status: 200 len: 146 microversion: 2.1 time: 0.045822 May 18 17:09:54.405363 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 198/410] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:09:54 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/ips => generated 146 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:09:58.569478 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:09:58.570276 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=49 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:09:58.575035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e648585a-73ce-4bb7-a4fb-3c222cc640d6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67eea5c6-4fd5-42d3-87b1-63b8324a2c8a"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:09:58.576194 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e648585a-73ce-4bb7-a4fb-3c222cc640d6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:09:58.584907 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e648585a-73ce-4bb7-a4fb-3c222cc640d6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:58.585360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e648585a-73ce-4bb7-a4fb-3c222cc640d6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:58.586178 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e648585a-73ce-4bb7-a4fb-3c222cc640d6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:09:58.586617 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e648585a-73ce-4bb7-a4fb-3c222cc640d6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:09:58.921087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e648585a-73ce-4bb7-a4fb-3c222cc640d6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.352427 May 18 17:09:58.921791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 213/411] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:09:58 2022] POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/os-volume_attachments => generated 194 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:10:06.449182 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f04ea9ee-858b-46e8-ab45-28f46b4999fa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:06.451380 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:06.452038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:06.459089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f04ea9ee-858b-46e8-ab45-28f46b4999fa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:06.459544 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f04ea9ee-858b-46e8-ab45-28f46b4999fa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:06.520426 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f04ea9ee-858b-46e8-ab45-28f46b4999fa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Going to try to stop instance {{(pid=117732) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 18 17:10:06.565038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f04ea9ee-858b-46e8-ab45-28f46b4999fa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/action" status: 202 len: 0 microversion: 2.1 time: 0.119765 May 18 17:10:06.565706 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 199/412] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:10:06 2022] POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:10:06.574849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-28a4340e-88ac-406d-9519-52db077a8506 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:06.575477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-28a4340e-88ac-406d-9519-52db077a8506 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:06.583135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28a4340e-88ac-406d-9519-52db077a8506 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:06.583584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28a4340e-88ac-406d-9519-52db077a8506 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:06.584372 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28a4340e-88ac-406d-9519-52db077a8506 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:06.584814 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28a4340e-88ac-406d-9519-52db077a8506 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:06.725288 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-28a4340e-88ac-406d-9519-52db077a8506 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:06.734469 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-28a4340e-88ac-406d-9519-52db077a8506 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.164277 May 18 17:10:06.735117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 214/413] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:06 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:07.753824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-306ad127-de5a-4d44-86ac-ca0d9263f251 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:07.754713 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-306ad127-de5a-4d44-86ac-ca0d9263f251 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:07.760907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-306ad127-de5a-4d44-86ac-ca0d9263f251 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:07.761346 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-306ad127-de5a-4d44-86ac-ca0d9263f251 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:07.762139 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-306ad127-de5a-4d44-86ac-ca0d9263f251 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:07.762567 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-306ad127-de5a-4d44-86ac-ca0d9263f251 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:07.902578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-306ad127-de5a-4d44-86ac-ca0d9263f251 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:07.911710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-306ad127-de5a-4d44-86ac-ca0d9263f251 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.163002 May 18 17:10:07.912306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 200/414] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:07 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:08.091164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7b140890-12b1-4977-8bcd-bf00c3cd8d3e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:08.091658 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7b140890-12b1-4977-8bcd-bf00c3cd8d3e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:08.098484 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b140890-12b1-4977-8bcd-bf00c3cd8d3e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:08.098928 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b140890-12b1-4977-8bcd-bf00c3cd8d3e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:08.099700 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b140890-12b1-4977-8bcd-bf00c3cd8d3e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:08.100122 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7b140890-12b1-4977-8bcd-bf00c3cd8d3e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:08.123983 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7b140890-12b1-4977-8bcd-bf00c3cd8d3e tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/ips" status: 200 len: 148 microversion: 2.1 time: 0.036868 May 18 17:10:08.124556 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 215/415] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:10:08 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/ips => generated 148 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:10:08.929394 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-673f982e-2dd3-4145-be4c-bd229a007ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:08.930022 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-673f982e-2dd3-4145-be4c-bd229a007ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:08.936456 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-673f982e-2dd3-4145-be4c-bd229a007ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:08.936906 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-673f982e-2dd3-4145-be4c-bd229a007ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:08.937674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-673f982e-2dd3-4145-be4c-bd229a007ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:08.938100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-673f982e-2dd3-4145-be4c-bd229a007ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:09.070696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-673f982e-2dd3-4145-be4c-bd229a007ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:09.078900 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-673f982e-2dd3-4145-be4c-bd229a007ebb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.153408 May 18 17:10:09.079470 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 201/416] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:08 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:10.096549 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-763fcba1-3873-4d17-a937-2f6f26b6de16 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:10.097967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-763fcba1-3873-4d17-a937-2f6f26b6de16 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:10.104674 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-763fcba1-3873-4d17-a937-2f6f26b6de16 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:10.105127 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-763fcba1-3873-4d17-a937-2f6f26b6de16 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:10.105911 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-763fcba1-3873-4d17-a937-2f6f26b6de16 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:10.106359 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-763fcba1-3873-4d17-a937-2f6f26b6de16 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:10.245311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-763fcba1-3873-4d17-a937-2f6f26b6de16 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:10.253946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-763fcba1-3873-4d17-a937-2f6f26b6de16 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.161007 May 18 17:10:10.254543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 216/417] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:10 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:10.693884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-62d903ae-e672-4f87-bb0e-aa40d1f7b983 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d95d4492-5ae5-4d7a-8721-eff478ae0742"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:10.695011 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-62d903ae-e672-4f87-bb0e-aa40d1f7b983 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:10.701470 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62d903ae-e672-4f87-bb0e-aa40d1f7b983 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:10.701958 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62d903ae-e672-4f87-bb0e-aa40d1f7b983 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:10.702722 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62d903ae-e672-4f87-bb0e-aa40d1f7b983 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:10.703164 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-62d903ae-e672-4f87-bb0e-aa40d1f7b983 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:10.963629 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-62d903ae-e672-4f87-bb0e-aa40d1f7b983 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274198 May 18 17:10:10.964256 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 202/418] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:10:10 2022] POST /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:10:11.274112 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1eceb62c-827a-424c-bd08-a816423444ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:11.274647 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1eceb62c-827a-424c-bd08-a816423444ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:11.281267 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1eceb62c-827a-424c-bd08-a816423444ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:11.281744 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1eceb62c-827a-424c-bd08-a816423444ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:11.282531 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1eceb62c-827a-424c-bd08-a816423444ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:11.282962 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1eceb62c-827a-424c-bd08-a816423444ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:11.418739 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1eceb62c-827a-424c-bd08-a816423444ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:11.427813 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1eceb62c-827a-424c-bd08-a816423444ca tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.157498 May 18 17:10:11.428397 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 217/419] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:11 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:12.446427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5ab05c0e-26e6-4fc0-9441-662d5b8128b0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:12.447124 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5ab05c0e-26e6-4fc0-9441-662d5b8128b0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:12.453363 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ab05c0e-26e6-4fc0-9441-662d5b8128b0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:12.453858 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ab05c0e-26e6-4fc0-9441-662d5b8128b0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:12.454626 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ab05c0e-26e6-4fc0-9441-662d5b8128b0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:12.455067 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ab05c0e-26e6-4fc0-9441-662d5b8128b0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:12.590423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5ab05c0e-26e6-4fc0-9441-662d5b8128b0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:12.598542 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5ab05c0e-26e6-4fc0-9441-662d5b8128b0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.157812 May 18 17:10:12.599112 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 203/420] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:12 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:13.615494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-41f4082c-5061-4771-bc17-86507b9981b7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:13.616152 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-41f4082c-5061-4771-bc17-86507b9981b7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:13.625285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-41f4082c-5061-4771-bc17-86507b9981b7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:13.625776 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-41f4082c-5061-4771-bc17-86507b9981b7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:13.626577 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-41f4082c-5061-4771-bc17-86507b9981b7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:13.627017 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-41f4082c-5061-4771-bc17-86507b9981b7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:13.789294 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-41f4082c-5061-4771-bc17-86507b9981b7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:13.797720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-41f4082c-5061-4771-bc17-86507b9981b7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.186327 May 18 17:10:13.798298 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 218/421] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:13 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:14.818562 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ac150264-fc9c-4c1f-a169-f7ef05e0fcae tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:14.819186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ac150264-fc9c-4c1f-a169-f7ef05e0fcae tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:14.825915 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ac150264-fc9c-4c1f-a169-f7ef05e0fcae tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:14.826369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ac150264-fc9c-4c1f-a169-f7ef05e0fcae tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:14.827145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ac150264-fc9c-4c1f-a169-f7ef05e0fcae tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:14.827580 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ac150264-fc9c-4c1f-a169-f7ef05e0fcae tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:14.970950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ac150264-fc9c-4c1f-a169-f7ef05e0fcae tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:14.979249 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ac150264-fc9c-4c1f-a169-f7ef05e0fcae tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.166321 May 18 17:10:14.979754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 204/422] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:14 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:15.998466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-082cdce2-89e9-4351-a869-ab4145ffcdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:15.999076 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-082cdce2-89e9-4351-a869-ab4145ffcdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:16.006151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-082cdce2-89e9-4351-a869-ab4145ffcdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:16.006602 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-082cdce2-89e9-4351-a869-ab4145ffcdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:16.007361 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-082cdce2-89e9-4351-a869-ab4145ffcdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:16.007799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-082cdce2-89e9-4351-a869-ab4145ffcdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:16.136334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-082cdce2-89e9-4351-a869-ab4145ffcdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:16.145008 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-082cdce2-89e9-4351-a869-ab4145ffcdf7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.151893 May 18 17:10:16.145572 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 219/423] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:15 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:17.162775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f8681c53-7080-4384-be21-addab2250094 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:17.163362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f8681c53-7080-4384-be21-addab2250094 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:17.170065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f8681c53-7080-4384-be21-addab2250094 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:17.170511 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f8681c53-7080-4384-be21-addab2250094 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:17.171262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f8681c53-7080-4384-be21-addab2250094 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:17.171691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f8681c53-7080-4384-be21-addab2250094 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:17.303940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f8681c53-7080-4384-be21-addab2250094 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:17.312001 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f8681c53-7080-4384-be21-addab2250094 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.153578 May 18 17:10:17.312979 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 205/424] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:17 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:18.329990 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-553f4665-d2ef-4594-bfed-1e0b331cc90c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:18.330544 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-553f4665-d2ef-4594-bfed-1e0b331cc90c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:18.337925 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-553f4665-d2ef-4594-bfed-1e0b331cc90c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:18.338371 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-553f4665-d2ef-4594-bfed-1e0b331cc90c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:18.339163 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-553f4665-d2ef-4594-bfed-1e0b331cc90c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:18.339624 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-553f4665-d2ef-4594-bfed-1e0b331cc90c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:18.700760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-553f4665-d2ef-4594-bfed-1e0b331cc90c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:18.709040 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-553f4665-d2ef-4594-bfed-1e0b331cc90c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.383018 May 18 17:10:18.709616 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 220/425] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:18 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:19.536910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-acfd7f0d-0359-42ab-87f1-2c3252649f90 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: .version_select at 0x7fef003db790>, body: {"keypair": {"name": "tempest-keypair-2058820505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6r1c1f7ozxV+VUlF8YYf3gGhFNUZj4uTcUQPjyt31rS1Z2AU88BEqPHjpILjM0dAYSI+Ug/BKkEEa1XNd3JoQJ9wjOqkVYbw9d6md9umdXlWKQHR0N8pWcwB/tLjVWKg=="}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:19.556276 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-acfd7f0d-0359-42ab-87f1-2c3252649f90 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:10:19.561169 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-acfd7f0d-0359-42ab-87f1-2c3252649f90 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for user 01881ccdf756480b8fcc1ac599fdf905 and project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:10:19.598947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-acfd7f0d-0359-42ab-87f1-2c3252649f90 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.066214 May 18 17:10:19.599538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 206/426] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:10:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:10:19.727090 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c6608341-e99e-4fa2-9f33-d9aa735c7460 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:19.728223 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c6608341-e99e-4fa2-9f33-d9aa735c7460 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:19.735070 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6608341-e99e-4fa2-9f33-d9aa735c7460 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:19.735516 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6608341-e99e-4fa2-9f33-d9aa735c7460 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:19.736566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6608341-e99e-4fa2-9f33-d9aa735c7460 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:19.737060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6608341-e99e-4fa2-9f33-d9aa735c7460 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:19.915059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c6608341-e99e-4fa2-9f33-d9aa735c7460 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:19.923238 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c6608341-e99e-4fa2-9f33-d9aa735c7460 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.199919 May 18 17:10:19.923810 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 221/427] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:19 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:20.940630 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-324c4bec-5ca3-4566-a7e7-02d9d45b5d72 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:20.941437 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-324c4bec-5ca3-4566-a7e7-02d9d45b5d72 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:20.950113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-324c4bec-5ca3-4566-a7e7-02d9d45b5d72 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:20.950554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-324c4bec-5ca3-4566-a7e7-02d9d45b5d72 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:20.951447 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-324c4bec-5ca3-4566-a7e7-02d9d45b5d72 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:20.951878 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-324c4bec-5ca3-4566-a7e7-02d9d45b5d72 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:21.009692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1483778217", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1747880-dcf4-4125-af66-c635d137ec57"}], "security_groups": [{"name": "tempest-securitygroup--807503793"}], "key_name": "tempest-keypair-2058820505", "user_data": "}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:21.092894 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-324c4bec-5ca3-4566-a7e7-02d9d45b5d72 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:21.101792 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-324c4bec-5ca3-4566-a7e7-02d9d45b5d72 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1723 microversion: 2.1 time: 0.165356 May 18 17:10:21.102371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 207/428] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:20 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:21.121562 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] validate_networks() for [('f1747880-dcf4-4125-af66-c635d137ec57', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:10:21.497162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:10:21.497593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:10:21.498103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:10:21.498520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:10:21.498938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:10:21.508519 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:21.508971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:21.509803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:21.510244 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:21.527188 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:10:21.531091 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for user 01881ccdf756480b8fcc1ac599fdf905 and project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:10:21.542415 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:10:21.544677 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:10:21.591612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-552e2148-f4c5-4385-b523-26edead46b26 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.586304 May 18 17:10:21.592252 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 222/429] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:10:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:10:21.603584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d8e742e1-c06e-4218-bc6c-0884be2fc121 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:21.604294 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d8e742e1-c06e-4218-bc6c-0884be2fc121 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:21.660787 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d8e742e1-c06e-4218-bc6c-0884be2fc121 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:21.669287 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d8e742e1-c06e-4218-bc6c-0884be2fc121 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1242 microversion: 2.1 time: 0.070149 May 18 17:10:21.670035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 208/430] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:21 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:10:22.119492 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bd5b7240-300e-4102-8968-51e2accb2e1a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:22.120207 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bd5b7240-300e-4102-8968-51e2accb2e1a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:22.127306 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bd5b7240-300e-4102-8968-51e2accb2e1a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:22.127851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bd5b7240-300e-4102-8968-51e2accb2e1a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:22.129257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bd5b7240-300e-4102-8968-51e2accb2e1a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:22.129803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bd5b7240-300e-4102-8968-51e2accb2e1a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:22.261295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bd5b7240-300e-4102-8968-51e2accb2e1a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:22.269463 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bd5b7240-300e-4102-8968-51e2accb2e1a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1700 microversion: 2.1 time: 0.154350 May 18 17:10:22.270279 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 223/431] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:22 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1700 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:22.286311 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6807dd35-6bd6-4b4a-aecf-846891d0a1b3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:22.293525 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6807dd35-6bd6-4b4a-aecf-846891d0a1b3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:22.294015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6807dd35-6bd6-4b4a-aecf-846891d0a1b3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:22.315638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6807dd35-6bd6-4b4a-aecf-846891d0a1b3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Going to try to start instance {{(pid=117732) start /opt/stack/nova/nova/compute/api.py:2730}} May 18 17:10:22.357539 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6807dd35-6bd6-4b4a-aecf-846891d0a1b3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/action" status: 202 len: 0 microversion: 2.1 time: 0.075269 May 18 17:10:22.358172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 209/432] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:10:22 2022] POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:10:22.366683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e19bc8bc-5b16-42f0-b44c-9f199e0ffb06 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:22.367298 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e19bc8bc-5b16-42f0-b44c-9f199e0ffb06 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:22.373376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e19bc8bc-5b16-42f0-b44c-9f199e0ffb06 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:22.373863 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e19bc8bc-5b16-42f0-b44c-9f199e0ffb06 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:22.374637 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e19bc8bc-5b16-42f0-b44c-9f199e0ffb06 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:22.375074 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e19bc8bc-5b16-42f0-b44c-9f199e0ffb06 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:22.505893 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e19bc8bc-5b16-42f0-b44c-9f199e0ffb06 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:22.516419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e19bc8bc-5b16-42f0-b44c-9f199e0ffb06 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1709 microversion: 2.1 time: 0.153209 May 18 17:10:22.516419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 224/433] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:22 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:22.688764 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-480ab509-7364-4849-b419-2b306f7c4fde tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:22.689828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-480ab509-7364-4849-b419-2b306f7c4fde tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:22.697048 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-480ab509-7364-4849-b419-2b306f7c4fde tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:22.697882 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-480ab509-7364-4849-b419-2b306f7c4fde tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:22.698902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-480ab509-7364-4849-b419-2b306f7c4fde tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:22.699557 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-480ab509-7364-4849-b419-2b306f7c4fde tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:22.778546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-480ab509-7364-4849-b419-2b306f7c4fde tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:22.790250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-480ab509-7364-4849-b419-2b306f7c4fde tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1312 microversion: 2.1 time: 0.106933 May 18 17:10:22.794367 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 210/434] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:22 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:23.532680 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3b58ab14-80b0-48f6-a90c-9c05c8b22f36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:23.533291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3b58ab14-80b0-48f6-a90c-9c05c8b22f36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:23.540687 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b58ab14-80b0-48f6-a90c-9c05c8b22f36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:23.541128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b58ab14-80b0-48f6-a90c-9c05c8b22f36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:23.541945 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b58ab14-80b0-48f6-a90c-9c05c8b22f36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:23.542376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b58ab14-80b0-48f6-a90c-9c05c8b22f36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:23.685631 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3b58ab14-80b0-48f6-a90c-9c05c8b22f36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:23.695062 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3b58ab14-80b0-48f6-a90c-9c05c8b22f36 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1709 microversion: 2.1 time: 0.166120 May 18 17:10:23.695642 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 225/435] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:23 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1709 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:23.811926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1b5490af-9088-48da-914c-1d31c97f095f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:23.812566 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1b5490af-9088-48da-914c-1d31c97f095f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:23.820371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b5490af-9088-48da-914c-1d31c97f095f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:23.820819 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b5490af-9088-48da-914c-1d31c97f095f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:23.821601 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b5490af-9088-48da-914c-1d31c97f095f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:23.822617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b5490af-9088-48da-914c-1d31c97f095f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:24.022184 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1b5490af-9088-48da-914c-1d31c97f095f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:24.029671 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1b5490af-9088-48da-914c-1d31c97f095f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.221670 May 18 17:10:24.030465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 211/436] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:23 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:24.273212 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-436df139-5805-4b04-8f88-ebcf531980bd req-4682b0c2-31e6-4a16-a7f5-06030f95256b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8e9b40-b673-4589-8cc1-578d155c9f9a", "tag": "614f9000-57d7-40d6-bb66-cd4695782044"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:24.283548 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-436df139-5805-4b04-8f88-ebcf531980bd req-4682b0c2-31e6-4a16-a7f5-06030f95256b service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:24.284084 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-436df139-5805-4b04-8f88-ebcf531980bd req-4682b0c2-31e6-4a16-a7f5-06030f95256b service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:24.302184 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-436df139-5805-4b04-8f88-ebcf531980bd req-4682b0c2-31e6-4a16-a7f5-06030f95256b service nova] Creating event network-changed:614f9000-57d7-40d6-bb66-cd4695782044 for instance fe8e9b40-b673-4589-8cc1-578d155c9f9a on hv-cinder-79578 May 18 17:10:24.308025 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-436df139-5805-4b04-8f88-ebcf531980bd req-4682b0c2-31e6-4a16-a7f5-06030f95256b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040877 May 18 17:10:24.308652 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 226/437] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:10:24.719448 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6b8d935d-1bb0-45e8-ab95-6ee725f7b74a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:24.720094 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6b8d935d-1bb0-45e8-ab95-6ee725f7b74a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:24.727786 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b8d935d-1bb0-45e8-ab95-6ee725f7b74a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:24.728276 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b8d935d-1bb0-45e8-ab95-6ee725f7b74a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:24.729063 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b8d935d-1bb0-45e8-ab95-6ee725f7b74a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:24.729551 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b8d935d-1bb0-45e8-ab95-6ee725f7b74a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:24.949993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6b8d935d-1bb0-45e8-ab95-6ee725f7b74a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:24.958101 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6b8d935d-1bb0-45e8-ab95-6ee725f7b74a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1713 microversion: 2.1 time: 0.243116 May 18 17:10:24.958780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 212/438] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:24 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1713 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:25.047572 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-16913349-c4b8-4ae9-8ace-b9ec6606b67c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:25.048383 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-16913349-c4b8-4ae9-8ace-b9ec6606b67c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:25.055190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16913349-c4b8-4ae9-8ace-b9ec6606b67c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:25.055648 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16913349-c4b8-4ae9-8ace-b9ec6606b67c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:25.056621 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16913349-c4b8-4ae9-8ace-b9ec6606b67c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:25.057223 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-16913349-c4b8-4ae9-8ace-b9ec6606b67c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:25.195647 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-16913349-c4b8-4ae9-8ace-b9ec6606b67c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:25.202986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-16913349-c4b8-4ae9-8ace-b9ec6606b67c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.159668 May 18 17:10:25.203551 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 227/439] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:25 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:26.220929 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3385e8b2-1180-4357-8837-2a0b002ebf5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:26.221536 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3385e8b2-1180-4357-8837-2a0b002ebf5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:26.228639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3385e8b2-1180-4357-8837-2a0b002ebf5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:26.229084 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3385e8b2-1180-4357-8837-2a0b002ebf5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:26.229886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3385e8b2-1180-4357-8837-2a0b002ebf5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:26.230321 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3385e8b2-1180-4357-8837-2a0b002ebf5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:26.367093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3385e8b2-1180-4357-8837-2a0b002ebf5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:26.374885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3385e8b2-1180-4357-8837-2a0b002ebf5f tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.157722 May 18 17:10:26.375465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 213/440] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:26 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:27.392611 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-db8b8b4b-be3e-4353-8b00-b1fa5b5fbbc4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:27.393133 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-db8b8b4b-be3e-4353-8b00-b1fa5b5fbbc4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:27.399806 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db8b8b4b-be3e-4353-8b00-b1fa5b5fbbc4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:27.400258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db8b8b4b-be3e-4353-8b00-b1fa5b5fbbc4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:27.401033 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db8b8b4b-be3e-4353-8b00-b1fa5b5fbbc4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:27.401471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db8b8b4b-be3e-4353-8b00-b1fa5b5fbbc4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:27.531920 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-db8b8b4b-be3e-4353-8b00-b1fa5b5fbbc4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:27.539466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-db8b8b4b-be3e-4353-8b00-b1fa5b5fbbc4 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.151067 May 18 17:10:27.540040 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 228/441] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:27 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:28.555833 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d7418da1-5f71-4fdb-941b-03ec71e86c84 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:28.556487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d7418da1-5f71-4fdb-941b-03ec71e86c84 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:28.563389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7418da1-5f71-4fdb-941b-03ec71e86c84 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:28.563843 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7418da1-5f71-4fdb-941b-03ec71e86c84 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:28.564621 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7418da1-5f71-4fdb-941b-03ec71e86c84 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:28.565056 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7418da1-5f71-4fdb-941b-03ec71e86c84 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:28.570484 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:28.709761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d7418da1-5f71-4fdb-941b-03ec71e86c84 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:28.717506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d7418da1-5f71-4fdb-941b-03ec71e86c84 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.165602 May 18 17:10:28.718101 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 214/442] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:28 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:29.734370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-043d0131-88a9-4709-bf3f-e1f4a929af05 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:29.734915 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-043d0131-88a9-4709-bf3f-e1f4a929af05 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:29.736831 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:29.742443 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-043d0131-88a9-4709-bf3f-e1f4a929af05 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:29.742901 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-043d0131-88a9-4709-bf3f-e1f4a929af05 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:29.743710 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-043d0131-88a9-4709-bf3f-e1f4a929af05 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:29.744151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-043d0131-88a9-4709-bf3f-e1f4a929af05 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:29.747610 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:29.881424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-043d0131-88a9-4709-bf3f-e1f4a929af05 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:29.888861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-043d0131-88a9-4709-bf3f-e1f4a929af05 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.158568 May 18 17:10:29.889430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 229/443] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:29 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:30.906298 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-35684125-9ab6-46f0-bad5-4b4ec57e410b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:30.906902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-35684125-9ab6-46f0-bad5-4b4ec57e410b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:30.914144 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35684125-9ab6-46f0-bad5-4b4ec57e410b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:30.914583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35684125-9ab6-46f0-bad5-4b4ec57e410b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:30.915334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35684125-9ab6-46f0-bad5-4b4ec57e410b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:30.915760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35684125-9ab6-46f0-bad5-4b4ec57e410b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:31.047113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-35684125-9ab6-46f0-bad5-4b4ec57e410b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:31.054939 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-35684125-9ab6-46f0-bad5-4b4ec57e410b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.152527 May 18 17:10:31.055516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 215/444] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:30 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:31.463851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-bff571f0-7671-4cb6-aff2-6b19e82bd206 req-c51b4f78-001c-4c42-8b0b-907eb0e6d039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8e9b40-b673-4589-8cc1-578d155c9f9a", "name": "network-vif-plugged", "status": "completed", "tag": "614f9000-57d7-40d6-bb66-cd4695782044"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:31.473218 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-bff571f0-7671-4cb6-aff2-6b19e82bd206 req-c51b4f78-001c-4c42-8b0b-907eb0e6d039 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:31.473906 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-bff571f0-7671-4cb6-aff2-6b19e82bd206 req-c51b4f78-001c-4c42-8b0b-907eb0e6d039 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:31.485854 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-bff571f0-7671-4cb6-aff2-6b19e82bd206 req-c51b4f78-001c-4c42-8b0b-907eb0e6d039 service nova] Creating event network-vif-plugged:614f9000-57d7-40d6-bb66-cd4695782044 for instance fe8e9b40-b673-4589-8cc1-578d155c9f9a on hv-cinder-79578 May 18 17:10:31.491107 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-bff571f0-7671-4cb6-aff2-6b19e82bd206 req-c51b4f78-001c-4c42-8b0b-907eb0e6d039 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030920 May 18 17:10:31.491913 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 230/445] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:10:32.072038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-410d6aa2-dcef-465c-bb2f-6130598cb2d3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:32.072818 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-410d6aa2-dcef-465c-bb2f-6130598cb2d3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:32.074705 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:32.080582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-410d6aa2-dcef-465c-bb2f-6130598cb2d3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:32.081035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-410d6aa2-dcef-465c-bb2f-6130598cb2d3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:32.082917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-410d6aa2-dcef-465c-bb2f-6130598cb2d3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:32.083418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-410d6aa2-dcef-465c-bb2f-6130598cb2d3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:32.216205 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-410d6aa2-dcef-465c-bb2f-6130598cb2d3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:32.223813 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-410d6aa2-dcef-465c-bb2f-6130598cb2d3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.155611 May 18 17:10:32.224383 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 216/446] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:32 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:33.238303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:33.239640 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:33.244200 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b6c70771-eb0b-49ab-93a6-67ccc648cae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:33.244899 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b6c70771-eb0b-49ab-93a6-67ccc648cae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:33.252111 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6c70771-eb0b-49ab-93a6-67ccc648cae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:33.252593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6c70771-eb0b-49ab-93a6-67ccc648cae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:33.253982 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6c70771-eb0b-49ab-93a6-67ccc648cae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:33.255039 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b6c70771-eb0b-49ab-93a6-67ccc648cae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:33.385106 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b6c70771-eb0b-49ab-93a6-67ccc648cae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:33.392612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b6c70771-eb0b-49ab-93a6-67ccc648cae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1367 microversion: 2.1 time: 0.155828 May 18 17:10:33.393180 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 231/447] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:33 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:34.410242 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-34b4d2f5-6f90-4da1-958b-df3f34cb3736 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:34.410907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-34b4d2f5-6f90-4da1-958b-df3f34cb3736 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:34.417929 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34b4d2f5-6f90-4da1-958b-df3f34cb3736 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:34.418397 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34b4d2f5-6f90-4da1-958b-df3f34cb3736 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:34.419165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34b4d2f5-6f90-4da1-958b-df3f34cb3736 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:34.419591 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34b4d2f5-6f90-4da1-958b-df3f34cb3736 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:34.548678 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-34b4d2f5-6f90-4da1-958b-df3f34cb3736 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:34.556860 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-34b4d2f5-6f90-4da1-958b-df3f34cb3736 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1556 microversion: 2.1 time: 0.150831 May 18 17:10:34.557417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 217/448] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:10:34 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:10:34.573399 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ebddceb9-6f21-4352-823e-071bec732dd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:34.573965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ebddceb9-6f21-4352-823e-071bec732dd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:34.580520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ebddceb9-6f21-4352-823e-071bec732dd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:34.580977 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ebddceb9-6f21-4352-823e-071bec732dd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:34.582001 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ebddceb9-6f21-4352-823e-071bec732dd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:34.582441 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ebddceb9-6f21-4352-823e-071bec732dd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:34.662921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ebddceb9-6f21-4352-823e-071bec732dd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093399 May 18 17:10:34.663513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 232/449] 10.222.0.49 () {58 vars in 1274 bytes} [Wed May 18 17:10:34 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:10:35.620430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-2770a50d-bbcc-4c89-a40d-9a49564e73ca req-356a08a2-0790-4b97-acf9-1265a8fe19bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8e9b40-b673-4589-8cc1-578d155c9f9a", "tag": "614f9000-57d7-40d6-bb66-cd4695782044"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:35.629018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-2770a50d-bbcc-4c89-a40d-9a49564e73ca req-356a08a2-0790-4b97-acf9-1265a8fe19bf service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:35.629466 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-2770a50d-bbcc-4c89-a40d-9a49564e73ca req-356a08a2-0790-4b97-acf9-1265a8fe19bf service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:35.640598 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-2770a50d-bbcc-4c89-a40d-9a49564e73ca req-356a08a2-0790-4b97-acf9-1265a8fe19bf service nova] Creating event network-changed:614f9000-57d7-40d6-bb66-cd4695782044 for instance fe8e9b40-b673-4589-8cc1-578d155c9f9a on hv-cinder-79578 May 18 17:10:35.645997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-2770a50d-bbcc-4c89-a40d-9a49564e73ca req-356a08a2-0790-4b97-acf9-1265a8fe19bf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029187 May 18 17:10:35.646677 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 218/450] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:10:38.471540 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0dbf21df-5d3b-45f6-9e4d-ade63eb57a7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:38.472156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0dbf21df-5d3b-45f6-9e4d-ade63eb57a7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:38.478048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dbf21df-5d3b-45f6-9e4d-ade63eb57a7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:38.478497 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dbf21df-5d3b-45f6-9e4d-ade63eb57a7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:38.479254 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dbf21df-5d3b-45f6-9e4d-ade63eb57a7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:38.479686 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0dbf21df-5d3b-45f6-9e4d-ade63eb57a7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:38.504562 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0dbf21df-5d3b-45f6-9e4d-ade63eb57a7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/ips" status: 200 len: 151 microversion: 2.20 time: 0.037352 May 18 17:10:38.505140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 233/451] 10.222.0.49 () {60 vars in 1288 bytes} [Wed May 18 17:10:38 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:10:41.413368 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6c0e07a4-dcff-4b8b-90c0-64f7d3e00821 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:10:41.414074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6c0e07a4-dcff-4b8b-90c0-64f7d3e00821 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:41.416564 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:41.423025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c0e07a4-dcff-4b8b-90c0-64f7d3e00821 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:41.423486 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c0e07a4-dcff-4b8b-90c0-64f7d3e00821 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:41.424256 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c0e07a4-dcff-4b8b-90c0-64f7d3e00821 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:41.424692 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c0e07a4-dcff-4b8b-90c0-64f7d3e00821 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:41.450119 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-6c0e07a4-dcff-4b8b-90c0-64f7d3e00821 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lazy-loading 'flavor' on Instance uuid e9559237-c858-41a6-ba99-09106ba78496 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:10:41.712341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6c0e07a4-dcff-4b8b-90c0-64f7d3e00821 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/action" status: 202 len: 0 microversion: 2.20 time: 0.303389 May 18 17:10:41.713091 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 219/452] 10.222.0.49 () {62 vars in 1318 bytes} [Wed May 18 17:10:41 2022] POST /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 17:10:41.721881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:41.723063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:41.730970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:41.731428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:41.732386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:41.733615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:41.871266 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:41.879757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:41.881409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:41.883374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d322ebf7-b6e6-4494-9a3f-fa1033f9be02 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.164698 May 18 17:10:41.883374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 234/453] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:41 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:42.902221 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:42.902834 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:42.909156 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:42.909619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:42.910792 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:42.911232 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:43.040776 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:43.048670 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:43.051343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:43.052817 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-725f134f-5ec1-4cac-ba52-cd6ca688fa19 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.155466 May 18 17:10:43.053379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 220/454] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:42 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:44.072285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:44.072906 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:44.079534 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:44.079987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:44.080758 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:44.081198 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:44.212374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:44.220569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:44.222128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:44.223283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-564122ef-269e-4582-bd7b-5223ee30791c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.155363 May 18 17:10:44.223838 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 235/455] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:44 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:45.241747 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:45.242359 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:45.248837 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:45.249296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:45.250087 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:45.250528 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:45.386424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:45.395051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:45.396551 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:45.397733 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-33f835f3-7aaa-46a5-8b6f-c953ed181a9d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.160387 May 18 17:10:45.398290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 221/456] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:45 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:46.416029 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:46.416577 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:46.423048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:46.423596 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:46.424448 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:46.424882 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:46.555700 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:46.563553 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:46.565045 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:46.566310 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a2a97925-1bbe-42c4-b3c7-280a094feb43 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.154833 May 18 17:10:46.566939 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 236/457] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:46 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:47.584723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:47.585351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:47.592164 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:47.592675 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:47.593383 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:47.593940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:47.728475 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:47.736417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:47.738687 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:47.739845 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1bf52fa5-eca0-4530-9418-22ddc4a75fba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.159291 May 18 17:10:47.740406 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 222/458] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:47 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:48.758612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:48.759221 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:48.766006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:48.766449 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:48.767220 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:48.767658 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:48.905800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:48.913810 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:48.915295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:48.916431 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-74622b7d-0dd7-41ff-80fb-36b31955d277 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.161733 May 18 17:10:48.916969 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 237/459] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:48 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:49.935627 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:49.936407 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:49.943567 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:49.944135 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:49.945033 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:49.945476 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:50.179062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:50.187478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:50.189126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:50.190423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a97656ae-a473-4b5a-9b45-5ab0a37139a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.258749 May 18 17:10:50.191038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 223/460] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:49 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:51.208862 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:51.209466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:51.216358 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:51.216808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:51.217563 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:51.218027 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:51.349578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:51.357491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:51.359003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:51.360134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6095bfe9-580a-4b35-ac89-8075f2ab7fc9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.155268 May 18 17:10:51.360681 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 238/461] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:51 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:52.379383 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:52.379953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:52.386917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:52.387365 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:52.388122 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:52.388554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:52.627962 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:52.637000 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:52.638550 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:52.639710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7e0467c7-bc57-4667-ac65-96f8b957b201 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.264752 May 18 17:10:52.640266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 224/462] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:52 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:53.658207 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:53.658934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:53.666389 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:53.666838 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:53.667618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:53.668063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:53.899302 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:53.907965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:53.909595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:53.910743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-be1c642c-10bf-46c6-b5c9-07570c30bc88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.256863 May 18 17:10:53.911308 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 239/463] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:53 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:54.928953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:54.929620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:54.936223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:54.936671 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:54.937465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:54.937941 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:55.071535 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:55.079617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:55.081119 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:55.083149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e0e4ff96-1892-4578-9e9c-6695e9e33560 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.158342 May 18 17:10:55.083710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 225/464] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:54 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:10:56.101028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:56.101765 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:56.108374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:56.108845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:56.109646 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:56.110136 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:56.243028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:56.250960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:56.252464 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:56.253699 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-895e1f75-7ad8-4903-80c4-a1a6d17344e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.157090 May 18 17:10:56.254445 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 240/465] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:56 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:57.284471 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:57.285262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:57.291934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:57.292382 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:57.293155 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:57.293596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:57.436493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:57.446371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:57.447904 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:57.449082 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-afaf0104-cc83-4676-a3dc-f015c7fbe121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.180387 May 18 17:10:57.449644 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 226/466] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:57 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:58.468695 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:58.469334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:58.477091 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:58.477544 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:58.478344 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:58.478784 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:58.622234 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:58.630663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:58.632178 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:58.633247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d949a099-b44a-4180-99ff-f8c5a4b8b513 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.168765 May 18 17:10:58.633829 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 241/467] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:58 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:10:59.652208 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:10:59.652850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:10:59.659639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:59.660616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:59.661615 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:10:59.662097 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:10:59.665186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:10:59.797266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:59.805994 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:59.807488 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:10:59.808634 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-057d6adf-507b-4f26-9c06-3dd350486eb1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1744 microversion: 2.20 time: 0.160571 May 18 17:10:59.809196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 227/468] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:10:59 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:00.828803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:00.829533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:00.831433 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=26 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:00.837961 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:00.838424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:00.839204 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:00.839645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:00.843221 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=70 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:00.975961 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:00.984426 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:00.985976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:00.987156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0ca2ffe6-3ace-4269-8bca-f5cefbb90527 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1744 microversion: 2.20 time: 0.162900 May 18 17:11:00.987721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 242/469] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:00 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:02.008204 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:02.008831 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:02.015771 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:02.016212 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:02.017010 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:02.017438 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:02.158749 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:02.168450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:02.169964 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:02.171123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84eda185-fd68-4c85-bf13-e687e27b1c57 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1744 microversion: 2.20 time: 0.167562 May 18 17:11:02.171681 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 228/470] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:02 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:02.828371 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:11:02.828999 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Wed May 18 17:11:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:11:03.020331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a827a29d-6b9d-4446-8813-9069773ff0c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2e11d29-dfbf-450c-9f9e-70c351788920"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:03.021495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a827a29d-6b9d-4446-8813-9069773ff0c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:03.029285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a827a29d-6b9d-4446-8813-9069773ff0c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:03.029766 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a827a29d-6b9d-4446-8813-9069773ff0c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:03.030536 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a827a29d-6b9d-4446-8813-9069773ff0c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:03.030969 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a827a29d-6b9d-4446-8813-9069773ff0c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:03.192118 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:03.193945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:03.201852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:03.202254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:03.203039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:03.203474 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:03.335724 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a827a29d-6b9d-4446-8813-9069773ff0c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319796 May 18 17:11:03.336617 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 243/471] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:11:03 2022] POST /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:11:03.370288 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:03.379261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:03.380849 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:03.382057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1326d473-3eab-4286-ab37-4bff26f70938 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1744 microversion: 2.20 time: 0.195223 May 18 17:11:03.382614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 229/472] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:03 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:03.611800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-02da7b2f-dbb9-490e-a7bb-b824585984fd req-ee476b89-88dc-4575-996d-872c489d0454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9559237-c858-41a6-ba99-09106ba78496", "name": "network-vif-plugged", "status": "completed", "tag": "a59f32ad-7870-4083-b0d4-262a85cedd52"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:03.621639 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-02da7b2f-dbb9-490e-a7bb-b824585984fd req-ee476b89-88dc-4575-996d-872c489d0454 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:03.622124 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-02da7b2f-dbb9-490e-a7bb-b824585984fd req-ee476b89-88dc-4575-996d-872c489d0454 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:03.635479 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-02da7b2f-dbb9-490e-a7bb-b824585984fd req-ee476b89-88dc-4575-996d-872c489d0454 service nova] Creating event network-vif-plugged:a59f32ad-7870-4083-b0d4-262a85cedd52 for instance e9559237-c858-41a6-ba99-09106ba78496 on hv-cinder-79578 May 18 17:11:03.640738 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-02da7b2f-dbb9-490e-a7bb-b824585984fd req-ee476b89-88dc-4575-996d-872c489d0454 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033525 May 18 17:11:03.641587 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 244/473] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:11:04.400581 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:04.401124 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:04.407899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:04.408332 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:04.409144 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:04.409578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:04.759864 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:04.767766 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:04.769300 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:04.770864 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ad75a7d5-4fb5-46d5-b48e-06cd70b4bf46 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1744 microversion: 2.20 time: 0.374339 May 18 17:11:04.771425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 230/474] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:04 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1744 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:05.791294 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:05.791896 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:05.798621 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:05.799068 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:05.799870 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:05.800294 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:05.937976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:05.946912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:05.948400 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:05.949561 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d621a0fd-1845-4f4b-b560-ecfda8708f27 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1744 microversion: 2.20 time: 0.164369 May 18 17:11:05.950148 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 245/475] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:05 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:06.968516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:06.969111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:06.976217 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:06.976668 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:06.977442 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:06.977909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:07.125860 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:07.135279 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:07.136875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:07.138093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0acf3487-9f1e-40b3-ba63-87281f7751ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1744 microversion: 2.20 time: 0.173865 May 18 17:11:07.138667 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 231/476] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:06 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1744 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:08.157314 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:08.157968 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:08.166472 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:08.166929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:08.167725 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:08.168164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:08.316102 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:08.332989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:08.334729 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:08.336393 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7eea455e-edb0-43ef-bbda-f3359dd01f1c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1744 microversion: 2.20 time: 0.182852 May 18 17:11:08.337163 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 246/477] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:08 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:09.359749 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:09.360615 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:09.375364 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:09.376124 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:09.376911 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:09.377651 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:09.562341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:09.573153 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:09.575497 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:09.577610 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-38717cad-f579-4513-a104-fa51f933109d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.224069 May 18 17:11:09.579034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 232/478] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:09 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:10.606489 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:10.612417 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:10.631202 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:10.632317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:10.633798 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:10.634538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:10.842330 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:10.874831 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:10.877901 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:10.880806 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8e345d43-913e-4b3e-bd25-a695fe373303 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.282192 May 18 17:11:10.881743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 247/479] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:10 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:11.016029 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5ec8c89a-0d58-4e29-9a4b-d281584a577b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:11.017072 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5ec8c89a-0d58-4e29-9a4b-d281584a577b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:11.025467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ec8c89a-0d58-4e29-9a4b-d281584a577b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:11.025972 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ec8c89a-0d58-4e29-9a4b-d281584a577b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:11.026823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ec8c89a-0d58-4e29-9a4b-d281584a577b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:11.027457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ec8c89a-0d58-4e29-9a4b-d281584a577b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:11.054965 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-5ec8c89a-0d58-4e29-9a4b-d281584a577b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lazy-loading 'flavor' on Instance uuid 547563fc-2b40-4782-be59-1e1dfcbae2e9 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:11:11.216555 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5ec8c89a-0d58-4e29-9a4b-d281584a577b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/action" status: 200 len: 32 microversion: 2.1 time: 0.204497 May 18 17:11:11.217161 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 233/480] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:11:11 2022] POST /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/action => generated 32 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 17:11:11.227044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-08b7f8c3-db35-4a6b-8f6b-d1d316b4dec7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:11.227669 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-08b7f8c3-db35-4a6b-8f6b-d1d316b4dec7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:11.234001 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08b7f8c3-db35-4a6b-8f6b-d1d316b4dec7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:11.234446 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08b7f8c3-db35-4a6b-8f6b-d1d316b4dec7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:11.235233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08b7f8c3-db35-4a6b-8f6b-d1d316b4dec7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:11.235731 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-08b7f8c3-db35-4a6b-8f6b-d1d316b4dec7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:11.435859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-08b7f8c3-db35-4a6b-8f6b-d1d316b4dec7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:11.446734 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-08b7f8c3-db35-4a6b-8f6b-d1d316b4dec7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.224137 May 18 17:11:11.447349 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 248/481] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:11 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:11:11.913200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:11.913948 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:11.916015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=30 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:11.922700 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:11.923797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:11.924625 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:11.925073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:12.177712 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:12.191884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:12.193706 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:12.196522 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bc193dec-0b71-4937-8756-e22cec18a9b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.288705 May 18 17:11:12.210190 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 234/482] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:11 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:12.469316 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-279b0fd1-d5f5-4044-82bd-1dfa65a8e0c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:12.471198 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-279b0fd1-d5f5-4044-82bd-1dfa65a8e0c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:12.482875 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-279b0fd1-d5f5-4044-82bd-1dfa65a8e0c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:12.483951 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-279b0fd1-d5f5-4044-82bd-1dfa65a8e0c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:12.485614 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-279b0fd1-d5f5-4044-82bd-1dfa65a8e0c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:12.486642 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-279b0fd1-d5f5-4044-82bd-1dfa65a8e0c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:12.704610 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-279b0fd1-d5f5-4044-82bd-1dfa65a8e0c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:12.720549 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-279b0fd1-d5f5-4044-82bd-1dfa65a8e0c9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.258091 May 18 17:11:12.721067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 249/483] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:12 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:12.988301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:11:12.988519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:11:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:11:13.220504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:13.221688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:13.231641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:13.232455 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:13.233774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:13.234230 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:13.420705 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:13.430709 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:13.432699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:13.434128 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c8a31b5a-98b8-4601-be9a-2adc22362763 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.219063 May 18 17:11:13.445751 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 235/484] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:13 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:13.747624 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bafd3b03-bc47-41ac-90dd-7f947b2d90ea tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:13.748982 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bafd3b03-bc47-41ac-90dd-7f947b2d90ea tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:13.758028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bafd3b03-bc47-41ac-90dd-7f947b2d90ea tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:13.758478 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bafd3b03-bc47-41ac-90dd-7f947b2d90ea tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:13.759296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bafd3b03-bc47-41ac-90dd-7f947b2d90ea tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:13.759730 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bafd3b03-bc47-41ac-90dd-7f947b2d90ea tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:13.962711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bafd3b03-bc47-41ac-90dd-7f947b2d90ea tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:13.972469 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bafd3b03-bc47-41ac-90dd-7f947b2d90ea tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.231756 May 18 17:11:13.973926 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 250/485] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:13 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:14.453162 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:14.454469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:14.462385 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:14.462828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:14.463620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:14.464048 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:14.651527 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:14.666722 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:14.669635 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:14.672026 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-989fda7b-aff6-4f0f-ac69-d48c6aa0046f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.222543 May 18 17:11:14.673201 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 236/486] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:14 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:15.000430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d48fd3f2-50c4-4220-adb7-3351a66035af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:15.002533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d48fd3f2-50c4-4220-adb7-3351a66035af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:15.014085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d48fd3f2-50c4-4220-adb7-3351a66035af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:15.014837 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d48fd3f2-50c4-4220-adb7-3351a66035af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:15.016084 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d48fd3f2-50c4-4220-adb7-3351a66035af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:15.016789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d48fd3f2-50c4-4220-adb7-3351a66035af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:15.225649 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d48fd3f2-50c4-4220-adb7-3351a66035af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:15.234929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d48fd3f2-50c4-4220-adb7-3351a66035af tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.241067 May 18 17:11:15.235844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 251/487] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:14 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:11:15.699172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:15.700113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:15.707185 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:15.708065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:15.709120 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:15.709859 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:15.883777 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:15.895159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:15.898608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:15.900747 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5b96233e-4eb9-4a0f-a672-089c36782e60 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.205284 May 18 17:11:15.901894 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 237/488] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:15 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:16.255739 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-39d57415-46f0-4f58-bd83-c9f28974a8e6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:16.256636 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-39d57415-46f0-4f58-bd83-c9f28974a8e6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:16.263930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-39d57415-46f0-4f58-bd83-c9f28974a8e6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:16.264380 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-39d57415-46f0-4f58-bd83-c9f28974a8e6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:16.265170 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-39d57415-46f0-4f58-bd83-c9f28974a8e6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:16.265617 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-39d57415-46f0-4f58-bd83-c9f28974a8e6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:16.469134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-39d57415-46f0-4f58-bd83-c9f28974a8e6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:16.479544 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-39d57415-46f0-4f58-bd83-c9f28974a8e6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.230514 May 18 17:11:16.484428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 252/489] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:16 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:16.934257 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:16.935554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:16.946291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:16.946743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:16.947590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:16.948096 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:17.127783 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:17.139131 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:17.140639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:17.141876 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-427c54c0-6158-4f23-8eb2-0a9279a4a776 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.213626 May 18 17:11:17.143915 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 238/490] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:16 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:17.498524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-00687ef1-9ef7-4a35-90db-fe67f271ac9e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:17.499125 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-00687ef1-9ef7-4a35-90db-fe67f271ac9e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:17.506988 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-00687ef1-9ef7-4a35-90db-fe67f271ac9e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:17.507594 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-00687ef1-9ef7-4a35-90db-fe67f271ac9e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:17.508418 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-00687ef1-9ef7-4a35-90db-fe67f271ac9e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:17.508950 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-00687ef1-9ef7-4a35-90db-fe67f271ac9e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:17.919504 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-00687ef1-9ef7-4a35-90db-fe67f271ac9e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:17.928765 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-00687ef1-9ef7-4a35-90db-fe67f271ac9e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.433889 May 18 17:11:17.929356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 253/491] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:17 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:18.160910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:18.162309 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:18.170063 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:18.170831 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:18.171765 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:18.172411 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:18.327556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:18.341398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:18.343306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:18.344630 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fba2881b-e09e-4aa6-b3f1-d1d2e8309db2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.188126 May 18 17:11:18.345215 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 239/492] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:18 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:18.946406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-864367d9-6a73-4ba9-9628-a32d3fe88d8e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:18.947760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-864367d9-6a73-4ba9-9628-a32d3fe88d8e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:18.955174 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-864367d9-6a73-4ba9-9628-a32d3fe88d8e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:18.956039 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-864367d9-6a73-4ba9-9628-a32d3fe88d8e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:18.957206 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-864367d9-6a73-4ba9-9628-a32d3fe88d8e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:18.957914 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-864367d9-6a73-4ba9-9628-a32d3fe88d8e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:19.196064 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-864367d9-6a73-4ba9-9628-a32d3fe88d8e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:19.205834 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-864367d9-6a73-4ba9-9628-a32d3fe88d8e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.263208 May 18 17:11:19.207717 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 254/493] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:18 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:19.364456 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:19.365227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:19.372655 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:19.373098 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:19.374017 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:19.374529 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:19.560435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:19.571552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:19.573129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:19.574556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6b094514-49d6-411d-a41d-68923ba12dda tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.215342 May 18 17:11:19.587795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 240/494] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:19 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:20.224591 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b61dd90f-ef91-424d-9e35-552f6403375a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:20.225380 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b61dd90f-ef91-424d-9e35-552f6403375a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:20.232012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b61dd90f-ef91-424d-9e35-552f6403375a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:20.232452 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b61dd90f-ef91-424d-9e35-552f6403375a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:20.233215 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b61dd90f-ef91-424d-9e35-552f6403375a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:20.233641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b61dd90f-ef91-424d-9e35-552f6403375a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:20.368088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b61dd90f-ef91-424d-9e35-552f6403375a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:20.376100 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b61dd90f-ef91-424d-9e35-552f6403375a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.156003 May 18 17:11:20.376661 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 255/495] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:20 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:20.595652 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:20.596196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:20.603388 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:20.603838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:20.604597 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:20.605043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:20.736337 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:20.739823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:20.747060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:20.748566 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:20.749764 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6cf4918c-eaf1-4dda-baa9-ad2c48f2756a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1739 microversion: 2.20 time: 0.158087 May 18 17:11:20.750322 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 241/496] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:20 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:21.395225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-91861cee-06ae-4df6-9914-a67efced4af6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:21.395957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-91861cee-06ae-4df6-9914-a67efced4af6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:21.402770 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91861cee-06ae-4df6-9914-a67efced4af6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:21.403223 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91861cee-06ae-4df6-9914-a67efced4af6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:21.404006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91861cee-06ae-4df6-9914-a67efced4af6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:21.404444 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91861cee-06ae-4df6-9914-a67efced4af6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:21.539048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91861cee-06ae-4df6-9914-a67efced4af6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:21.547436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-91861cee-06ae-4df6-9914-a67efced4af6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.157138 May 18 17:11:21.557930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 256/497] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:21 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:21.768487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:21.769142 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:21.776643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:21.777088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:21.777890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:21.778321 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:21.965810 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:21.975592 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:21.977096 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:21.978293 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1344372b-11c6-4557-a484-895409a5785a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1721 microversion: 2.20 time: 0.213791 May 18 17:11:21.978848 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 242/498] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:21 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1721 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:22.565565 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a2930d48-51d5-4ed3-9d6f-543860d6c6c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:22.566436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a2930d48-51d5-4ed3-9d6f-543860d6c6c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:22.573109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a2930d48-51d5-4ed3-9d6f-543860d6c6c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:22.573606 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a2930d48-51d5-4ed3-9d6f-543860d6c6c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:22.574428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a2930d48-51d5-4ed3-9d6f-543860d6c6c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:22.574873 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a2930d48-51d5-4ed3-9d6f-543860d6c6c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:22.712030 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a2930d48-51d5-4ed3-9d6f-543860d6c6c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:22.720444 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a2930d48-51d5-4ed3-9d6f-543860d6c6c5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.158756 May 18 17:11:22.721013 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 257/499] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:22 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:22.997519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:22.998169 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:23.006008 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:23.006408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:23.007177 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:23.007602 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:23.146468 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:23.155354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:23.156893 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:23.158274 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-06114c89-7231-471c-b773-f7b3979659ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1721 microversion: 2.20 time: 0.164680 May 18 17:11:23.158872 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 243/500] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:22 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:23.639646 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-e1c653e6-5b92-4254-90e9-8a6ac1319df3 req-e7a952f9-4b79-49fa-8fcd-22fd9ebf0cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9559237-c858-41a6-ba99-09106ba78496", "name": "network-vif-unplugged", "status": "completed", "tag": "a59f32ad-7870-4083-b0d4-262a85cedd52"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:23.649642 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e1c653e6-5b92-4254-90e9-8a6ac1319df3 req-e7a952f9-4b79-49fa-8fcd-22fd9ebf0cdb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:23.650123 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e1c653e6-5b92-4254-90e9-8a6ac1319df3 req-e7a952f9-4b79-49fa-8fcd-22fd9ebf0cdb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:23.654626 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:23.667957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-e1c653e6-5b92-4254-90e9-8a6ac1319df3 req-e7a952f9-4b79-49fa-8fcd-22fd9ebf0cdb service nova] Creating event network-vif-unplugged:a59f32ad-7870-4083-b0d4-262a85cedd52 for instance e9559237-c858-41a6-ba99-09106ba78496 on hv-cinder-79578 May 18 17:11:23.674233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-e1c653e6-5b92-4254-90e9-8a6ac1319df3 req-e7a952f9-4b79-49fa-8fcd-22fd9ebf0cdb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038113 May 18 17:11:23.675237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 258/501] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:11:23.738391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1a797933-b69b-4578-a14e-f02a0390dd6a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:23.739378 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1a797933-b69b-4578-a14e-f02a0390dd6a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:23.746265 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a797933-b69b-4578-a14e-f02a0390dd6a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:23.746815 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a797933-b69b-4578-a14e-f02a0390dd6a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:23.747677 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a797933-b69b-4578-a14e-f02a0390dd6a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:23.748186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1a797933-b69b-4578-a14e-f02a0390dd6a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:23.890130 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1a797933-b69b-4578-a14e-f02a0390dd6a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:23.898644 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1a797933-b69b-4578-a14e-f02a0390dd6a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.164155 May 18 17:11:23.899209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 244/502] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:23 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:24.179776 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:24.180475 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:24.186916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.187321 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.188088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.188526 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.321432 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:24.329451 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:24.331066 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:24.332222 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a44026e6-66f2-4ec4-86d6-09f31eef3023 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1664 microversion: 2.20 time: 0.158250 May 18 17:11:24.332946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 259/503] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:24 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:24.350525 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4d71e266-1040-47ac-b63a-a99399f8ae82 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ab1e63f-df04-4e53-9e06-1b1aa1d6a8ea"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:24.351629 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4d71e266-1040-47ac-b63a-a99399f8ae82 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:24.358175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d71e266-1040-47ac-b63a-a99399f8ae82 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.358616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d71e266-1040-47ac-b63a-a99399f8ae82 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.359370 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d71e266-1040-47ac-b63a-a99399f8ae82 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.359794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d71e266-1040-47ac-b63a-a99399f8ae82 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.642275 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4d71e266-1040-47ac-b63a-a99399f8ae82 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.296178 May 18 17:11:24.642966 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 245/504] 10.222.0.49 () {62 vars in 1363 bytes} [Wed May 18 17:11:24 2022] POST /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments => generated 188 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:11:24.766811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-45ab79ec-2dd9-401a-8355-42ba40b4ca08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:24.767495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-45ab79ec-2dd9-401a-8355-42ba40b4ca08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:24.775573 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45ab79ec-2dd9-401a-8355-42ba40b4ca08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.776027 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45ab79ec-2dd9-401a-8355-42ba40b4ca08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.776819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45ab79ec-2dd9-401a-8355-42ba40b4ca08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.777259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45ab79ec-2dd9-401a-8355-42ba40b4ca08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.916791 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2a6416e5-b09c-4710-ad4f-227856601e34 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:24.918128 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2a6416e5-b09c-4710-ad4f-227856601e34 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:24.925028 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a6416e5-b09c-4710-ad4f-227856601e34 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.925679 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a6416e5-b09c-4710-ad4f-227856601e34 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.927336 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a6416e5-b09c-4710-ad4f-227856601e34 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.927923 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a6416e5-b09c-4710-ad4f-227856601e34 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.937909 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-45ab79ec-2dd9-401a-8355-42ba40b4ca08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/action" status: 202 len: 0 microversion: 2.20 time: 0.175392 May 18 17:11:24.938525 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 260/505] 10.222.0.49 () {62 vars in 1318 bytes} [Wed May 18 17:11:24 2022] POST /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 18 17:11:24.948021 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:24.948655 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:24.955539 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.955913 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:24.956677 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:24.957109 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:25.095390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2a6416e5-b09c-4710-ad4f-227856601e34 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:25.104745 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2a6416e5-b09c-4710-ad4f-227856601e34 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.192563 May 18 17:11:25.105634 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 246/506] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:24 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:11:25.119866 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:25.128572 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:25.130457 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:25.131702 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-70308726-3df5-4267-bce9-5bceb0b66191 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1750 microversion: 2.20 time: 0.187723 May 18 17:11:25.132277 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 261/507] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:24 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1750 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:26.125503 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-582a269f-acd6-4563-8f59-8014a6248052 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:26.126173 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-582a269f-acd6-4563-8f59-8014a6248052 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:26.133537 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-582a269f-acd6-4563-8f59-8014a6248052 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:26.134016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-582a269f-acd6-4563-8f59-8014a6248052 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:26.134788 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-582a269f-acd6-4563-8f59-8014a6248052 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:26.135226 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-582a269f-acd6-4563-8f59-8014a6248052 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:26.149960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:26.150663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:26.156995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:26.157533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:26.158240 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:26.158673 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:26.277535 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-582a269f-acd6-4563-8f59-8014a6248052 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:26.286450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-582a269f-acd6-4563-8f59-8014a6248052 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.165044 May 18 17:11:26.287312 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 247/508] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:26 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:26.315407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:26.326538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:26.328912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:26.330897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4e1e83e7-5e37-454c-aaf5-3cccbca3a5c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1750 microversion: 2.20 time: 0.184755 May 18 17:11:26.332014 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 262/509] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:26 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1750 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:27.303193 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4720b609-51ba-4164-9d46-eca0ab6d7f57 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:27.303805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4720b609-51ba-4164-9d46-eca0ab6d7f57 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:27.310111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4720b609-51ba-4164-9d46-eca0ab6d7f57 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:27.310569 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4720b609-51ba-4164-9d46-eca0ab6d7f57 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:27.311351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4720b609-51ba-4164-9d46-eca0ab6d7f57 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:27.311789 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4720b609-51ba-4164-9d46-eca0ab6d7f57 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:27.350443 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:27.351063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:27.358097 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:27.358551 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:27.359337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:27.359778 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:27.466364 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4720b609-51ba-4164-9d46-eca0ab6d7f57 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:27.475395 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4720b609-51ba-4164-9d46-eca0ab6d7f57 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1738 microversion: 2.1 time: 0.176245 May 18 17:11:27.475974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 248/510] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:27 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1738 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:27.498107 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:27.508344 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:27.509972 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:27.511073 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-67a4a11c-7611-4bc0-9f35-1a19ece4e456 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1752 microversion: 2.20 time: 0.164538 May 18 17:11:27.511632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 263/511] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:27 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1752 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:28.492539 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fc85adf8-1602-49ce-bccf-ecc3e4b49bcf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:28.493264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fc85adf8-1602-49ce-bccf-ecc3e4b49bcf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:28.499922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc85adf8-1602-49ce-bccf-ecc3e4b49bcf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.500398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc85adf8-1602-49ce-bccf-ecc3e4b49bcf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.501174 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc85adf8-1602-49ce-bccf-ecc3e4b49bcf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.501611 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc85adf8-1602-49ce-bccf-ecc3e4b49bcf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.530930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:28.531529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:28.539272 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.539727 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.540513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.540951 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.640563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fc85adf8-1602-49ce-bccf-ecc3e4b49bcf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:28.649925 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fc85adf8-1602-49ce-bccf-ecc3e4b49bcf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1718 microversion: 2.1 time: 0.161281 May 18 17:11:28.650510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 249/512] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:28 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1718 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:11:28.681508 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:28.690225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:28.691729 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:28.693500 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-24c32f30-5ea5-42ab-9791-5410ab2d821d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.166467 May 18 17:11:28.694146 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 264/513] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:28 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:28.710990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:28.711848 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:28.720178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.720617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.721406 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.721884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.858403 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] HTTP exception thrown: Cannot 'detach_volume' instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 while it is in vm_state rescued May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Request method failure captured: May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments/e2e11d29-dfbf-450c-9f9e-70c351788920 HTTP/1.1 May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd7mhZqsvU-pGf7jhqBpZwoFEOMD7ZgntriICrKuuArePuDRkM58WnyFUIbPMb6g9J-eLPYfmczvVnkU2koaO0drl2hFLltVrrisVCkxp8Il7eqoibvrfNlsnqG5atcXRhjgVIjaLVxdAxtFvtgzQ8XDIuoZV8Tlq_cEpRqksjRaYo May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:11:28.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 5e28c0ca22d143eebe6fc93f85442a7f May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:11:28.861330 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Cannot 'detach_volume' instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 while it is in vm_state rescued May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'server_id': '547563fc-2b40-4782-be59-1e1dfcbae2e9', 'id': 'e2e11d29-dfbf-450c-9f9e-70c351788920'} May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:11:28.862897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 while it is in vm_state rescued May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 while it is in vm_state rescued May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:11:28.865009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Returning 409 to user: Cannot 'detach_volume' instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 while it is in vm_state rescued {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:11:28.866577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7d42db87-fd11-470a-b39d-08db0601f03a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "DELETE /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments/e2e11d29-dfbf-450c-9f9e-70c351788920" status: 409 len: 152 microversion: 2.1 time: 0.156780 May 18 17:11:28.866577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 250/514] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:11:28 2022] DELETE /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments/e2e11d29-dfbf-450c-9f9e-70c351788920 => generated 152 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 18 17:11:28.871806 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-35dfe906-f9b0-4816-ace5-d260756e68c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:28.872835 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-35dfe906-f9b0-4816-ace5-d260756e68c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:28.881385 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35dfe906-f9b0-4816-ace5-d260756e68c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.881957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35dfe906-f9b0-4816-ace5-d260756e68c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.883484 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35dfe906-f9b0-4816-ace5-d260756e68c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.884378 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-35dfe906-f9b0-4816-ace5-d260756e68c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.960367 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-35dfe906-f9b0-4816-ace5-d260756e68c2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "POST /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/action" status: 202 len: 0 microversion: 2.1 time: 0.092266 May 18 17:11:28.964103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 265/515] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:11:28 2022] POST /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:11:28.976850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-35145a59-7765-437e-907e-ddf6fd6f850b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:28.977507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-35145a59-7765-437e-907e-ddf6fd6f850b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:28.988414 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35145a59-7765-437e-907e-ddf6fd6f850b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.988884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35145a59-7765-437e-907e-ddf6fd6f850b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:28.990595 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35145a59-7765-437e-907e-ddf6fd6f850b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:28.991055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-35145a59-7765-437e-907e-ddf6fd6f850b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:29.231011 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-35145a59-7765-437e-907e-ddf6fd6f850b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:29.249943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-35145a59-7765-437e-907e-ddf6fd6f850b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.283935 May 18 17:11:29.251180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 251/516] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:28 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:29.714360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:29.715418 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:29.725193 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:29.725991 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:29.726811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:29.727253 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:29.876501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:29.886670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:29.888181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:29.889610 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c0fbedbe-c76d-45ca-b275-500e49f0c9ab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.179856 May 18 17:11:29.897956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 266/517] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:29 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:30.269581 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-755bbf33-a9d8-4a32-a2d2-465e7301a9ca tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:30.270171 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-755bbf33-a9d8-4a32-a2d2-465e7301a9ca tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:30.277077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-755bbf33-a9d8-4a32-a2d2-465e7301a9ca tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:30.277739 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-755bbf33-a9d8-4a32-a2d2-465e7301a9ca tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:30.278453 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-755bbf33-a9d8-4a32-a2d2-465e7301a9ca tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:30.278884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-755bbf33-a9d8-4a32-a2d2-465e7301a9ca tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:30.427930 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-755bbf33-a9d8-4a32-a2d2-465e7301a9ca tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:30.437808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-755bbf33-a9d8-4a32-a2d2-465e7301a9ca tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.172029 May 18 17:11:30.438950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 252/518] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:30 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:30.908370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:30.909546 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:30.911989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=52 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:30.917327 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:30.917807 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:30.918577 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:30.919017 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:31.066455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:31.083964 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:31.085933 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:31.087517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-999cd87a-8edd-4d7a-91c9-13b66ba360b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.182917 May 18 17:11:31.088704 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 267/519] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:30 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:31.457803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e373ce88-d58b-45fd-8c7a-b431631872e0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:31.460106 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e373ce88-d58b-45fd-8c7a-b431631872e0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:31.468159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e373ce88-d58b-45fd-8c7a-b431631872e0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:31.468611 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e373ce88-d58b-45fd-8c7a-b431631872e0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:31.469400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e373ce88-d58b-45fd-8c7a-b431631872e0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:31.469874 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e373ce88-d58b-45fd-8c7a-b431631872e0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:31.606397 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e373ce88-d58b-45fd-8c7a-b431631872e0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:31.615010 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e373ce88-d58b-45fd-8c7a-b431631872e0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.162902 May 18 17:11:31.615786 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 253/520] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:31 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:32.112259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:32.112879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:32.120011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:32.120467 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:32.121232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:32.121732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:32.257022 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:32.265797 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:32.267313 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:32.268519 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5ca84d15-5068-44d3-8293-95de208e1e30 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.160089 May 18 17:11:32.269083 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 268/521] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:32 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:32.632360 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-43a351eb-c791-4851-bd35-28ba930fefaf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:32.632969 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-43a351eb-c791-4851-bd35-28ba930fefaf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:32.639477 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-43a351eb-c791-4851-bd35-28ba930fefaf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:32.639929 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-43a351eb-c791-4851-bd35-28ba930fefaf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:32.640683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-43a351eb-c791-4851-bd35-28ba930fefaf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:32.641116 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-43a351eb-c791-4851-bd35-28ba930fefaf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:32.784964 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-43a351eb-c791-4851-bd35-28ba930fefaf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:32.797266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-43a351eb-c791-4851-bd35-28ba930fefaf tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.168798 May 18 17:11:32.797865 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 254/522] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:32 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:33.290337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:33.292076 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:33.299467 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:33.300171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:33.301022 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:33.302661 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:33.450583 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:33.459970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:33.462517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:33.463675 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-055ef46d-1e83-486c-a66a-73015d54e8b2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.180173 May 18 17:11:33.464230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 269/523] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:33 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:33.814854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-440b9ef2-85c1-40e6-8c16-7ef434a4fa03 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:33.815526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-440b9ef2-85c1-40e6-8c16-7ef434a4fa03 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:33.824773 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-440b9ef2-85c1-40e6-8c16-7ef434a4fa03 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:33.825186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-440b9ef2-85c1-40e6-8c16-7ef434a4fa03 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:33.826290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-440b9ef2-85c1-40e6-8c16-7ef434a4fa03 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:33.826953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-440b9ef2-85c1-40e6-8c16-7ef434a4fa03 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:33.967695 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-440b9ef2-85c1-40e6-8c16-7ef434a4fa03 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:33.969917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:33.978922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-440b9ef2-85c1-40e6-8c16-7ef434a4fa03 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.168048 May 18 17:11:33.979690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 255/524] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:33 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:34.482857 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:34.483468 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:34.490652 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:34.491098 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:34.491860 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:34.492298 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:34.632178 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:34.640693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:34.642200 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:34.643344 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2f97adde-771c-4dfb-ba77-563384bb8aef tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.164395 May 18 17:11:34.643895 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 270/525] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:34 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:34.996795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ef35c7fa-3c80-4c76-abbe-c01659a4245c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:34.997395 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ef35c7fa-3c80-4c76-abbe-c01659a4245c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:35.007283 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef35c7fa-3c80-4c76-abbe-c01659a4245c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:35.008498 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef35c7fa-3c80-4c76-abbe-c01659a4245c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:35.009557 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef35c7fa-3c80-4c76-abbe-c01659a4245c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:35.010101 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef35c7fa-3c80-4c76-abbe-c01659a4245c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:35.165279 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef35c7fa-3c80-4c76-abbe-c01659a4245c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:35.173489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ef35c7fa-3c80-4c76-abbe-c01659a4245c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.181160 May 18 17:11:35.174358 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 256/526] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:34 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:35.662245 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:35.663210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:35.670383 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:35.670845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:35.671626 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:35.672069 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:35.810372 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:35.819550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:35.821053 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:35.822252 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c3392284-48b9-4a66-8fec-c6a818b5ef7c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.164898 May 18 17:11:35.822816 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 271/527] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:35 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:36.191356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2b6794d1-f2a7-4cb4-ac6a-e7644c105f90 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:36.192002 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2b6794d1-f2a7-4cb4-ac6a-e7644c105f90 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:36.199162 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2b6794d1-f2a7-4cb4-ac6a-e7644c105f90 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:36.199614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2b6794d1-f2a7-4cb4-ac6a-e7644c105f90 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:36.200368 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2b6794d1-f2a7-4cb4-ac6a-e7644c105f90 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:36.200803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2b6794d1-f2a7-4cb4-ac6a-e7644c105f90 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:36.343533 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2b6794d1-f2a7-4cb4-ac6a-e7644c105f90 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:36.352510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2b6794d1-f2a7-4cb4-ac6a-e7644c105f90 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.164982 May 18 17:11:36.353066 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 257/528] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:36 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:36.840970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:36.842937 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:36.852556 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:36.853558 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:36.854734 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:36.855405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:37.009399 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:37.017907 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:37.019420 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:37.020670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-180bedd1-2539-4370-940b-0317a63705d6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.184028 May 18 17:11:37.021193 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 272/529] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:36 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:37.369536 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-99adf9b1-e361-4b8d-929b-bdef8f4d87c7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:37.370231 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-99adf9b1-e361-4b8d-929b-bdef8f4d87c7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:37.377831 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99adf9b1-e361-4b8d-929b-bdef8f4d87c7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:37.378292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99adf9b1-e361-4b8d-929b-bdef8f4d87c7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:37.379083 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99adf9b1-e361-4b8d-929b-bdef8f4d87c7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:37.379521 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-99adf9b1-e361-4b8d-929b-bdef8f4d87c7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:37.519308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-99adf9b1-e361-4b8d-929b-bdef8f4d87c7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:37.528822 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-99adf9b1-e361-4b8d-929b-bdef8f4d87c7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.163086 May 18 17:11:37.529579 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 258/530] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:37 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:38.039893 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:38.040594 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:38.047707 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:38.048191 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:38.048971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:38.049412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:38.066370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:38.209586 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:38.218374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:38.219858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:38.221060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c8fc87fd-2f6a-405a-b2e3-d4baaac265c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.185838 May 18 17:11:38.221556 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 273/531] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:38 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:38.547076 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e0d1216d-d2fa-400c-93ab-85d041eb7f9a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:38.547650 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e0d1216d-d2fa-400c-93ab-85d041eb7f9a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:38.555729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0d1216d-d2fa-400c-93ab-85d041eb7f9a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:38.556178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0d1216d-d2fa-400c-93ab-85d041eb7f9a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:38.556975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0d1216d-d2fa-400c-93ab-85d041eb7f9a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:38.557411 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0d1216d-d2fa-400c-93ab-85d041eb7f9a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:38.697379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0d1216d-d2fa-400c-93ab-85d041eb7f9a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:38.706464 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e0d1216d-d2fa-400c-93ab-85d041eb7f9a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.163214 May 18 17:11:38.707431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 259/532] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:38 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:39.239743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:39.240357 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:39.247184 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:39.247638 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:39.248406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:39.248845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:39.388059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:39.397546 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:39.399095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:39.400299 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-659f5419-5f45-4c5d-bd32-afd5dd834315 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.164628 May 18 17:11:39.401205 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 274/533] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:39 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:39.725726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-180b83c8-4456-421a-aae4-02e355ef711c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:39.726327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-180b83c8-4456-421a-aae4-02e355ef711c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:39.732850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-180b83c8-4456-421a-aae4-02e355ef711c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:39.733297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-180b83c8-4456-421a-aae4-02e355ef711c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:39.734294 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-180b83c8-4456-421a-aae4-02e355ef711c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:39.734529 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-180b83c8-4456-421a-aae4-02e355ef711c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:39.870093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-180b83c8-4456-421a-aae4-02e355ef711c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:39.879917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-180b83c8-4456-421a-aae4-02e355ef711c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.158576 May 18 17:11:39.889529 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 260/534] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:39 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:40.420325 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:40.421162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:40.429467 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:40.430054 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:40.431092 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:40.431602 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:40.576375 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:40.589645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:40.591583 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:40.593075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f176f201-f07e-4bb5-a97d-929a0c56bc54 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.178102 May 18 17:11:40.593732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 275/535] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:40 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:40.898018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-326867ea-ae90-4cf6-90ac-a8483791f986 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:40.898604 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-326867ea-ae90-4cf6-90ac-a8483791f986 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:40.905015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-326867ea-ae90-4cf6-90ac-a8483791f986 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:40.905462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-326867ea-ae90-4cf6-90ac-a8483791f986 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:40.906252 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-326867ea-ae90-4cf6-90ac-a8483791f986 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:40.906680 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-326867ea-ae90-4cf6-90ac-a8483791f986 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:41.046690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-326867ea-ae90-4cf6-90ac-a8483791f986 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:41.055686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-326867ea-ae90-4cf6-90ac-a8483791f986 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.162352 May 18 17:11:41.056249 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 261/536] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:40 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:41.612171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:41.612728 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:41.620474 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:41.620931 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:41.621726 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:41.622170 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:41.750637 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:41.759128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:41.760621 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:41.761815 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8bd0eebb-8c80-4217-8767-04a9e26b23b9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.153707 May 18 17:11:41.762382 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 276/537] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:41 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:42.072504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-82780976-5f33-41f4-b5ed-f5a85355806e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:42.073123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-82780976-5f33-41f4-b5ed-f5a85355806e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:42.075546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=56 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:42.080712 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82780976-5f33-41f4-b5ed-f5a85355806e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:42.081162 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82780976-5f33-41f4-b5ed-f5a85355806e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:42.081960 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82780976-5f33-41f4-b5ed-f5a85355806e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:42.082404 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82780976-5f33-41f4-b5ed-f5a85355806e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:42.217629 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-82780976-5f33-41f4-b5ed-f5a85355806e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:42.225894 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-82780976-5f33-41f4-b5ed-f5a85355806e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.157196 May 18 17:11:42.226472 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 262/538] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:42 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:42.779389 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:42.780000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:42.787466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:42.787916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:42.788685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:42.789125 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:42.920829 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:42.929480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:42.931010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:42.932186 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d695e82f-c214-413b-aac1-cf67319e2519 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.156759 May 18 17:11:42.932743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 277/539] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:42 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:43.243042 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cfcec9dd-9c40-4cf0-9c3d-7c8de61c9fac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:43.243656 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cfcec9dd-9c40-4cf0-9c3d-7c8de61c9fac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:43.250526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cfcec9dd-9c40-4cf0-9c3d-7c8de61c9fac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:43.250989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cfcec9dd-9c40-4cf0-9c3d-7c8de61c9fac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:43.251825 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cfcec9dd-9c40-4cf0-9c3d-7c8de61c9fac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:43.252306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cfcec9dd-9c40-4cf0-9c3d-7c8de61c9fac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:43.391548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cfcec9dd-9c40-4cf0-9c3d-7c8de61c9fac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:43.399646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cfcec9dd-9c40-4cf0-9c3d-7c8de61c9fac tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.160744 May 18 17:11:43.400210 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 263/540] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:43 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:43.950751 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:43.951347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:43.958549 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:43.959013 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:43.959790 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:43.960230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:44.089390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:44.098123 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:44.099621 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:44.100782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fba61810-d269-4075-bb84-3e411dbd8b98 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.153968 May 18 17:11:44.101327 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 278/541] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:43 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:44.417160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5d704d1e-2eb3-4618-a86a-13d7a5d7f726 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:44.417718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5d704d1e-2eb3-4618-a86a-13d7a5d7f726 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:44.424191 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5d704d1e-2eb3-4618-a86a-13d7a5d7f726 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:44.424632 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5d704d1e-2eb3-4618-a86a-13d7a5d7f726 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:44.425379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5d704d1e-2eb3-4618-a86a-13d7a5d7f726 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:44.425839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5d704d1e-2eb3-4618-a86a-13d7a5d7f726 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:44.556865 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5d704d1e-2eb3-4618-a86a-13d7a5d7f726 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:44.564793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5d704d1e-2eb3-4618-a86a-13d7a5d7f726 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.151567 May 18 17:11:44.565354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 264/542] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:44 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:45.118917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:45.119552 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:45.126034 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:45.126477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:45.127231 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:45.127664 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:45.260386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:45.269341 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:45.271513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:45.272719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1dfee91e-0d27-4c61-b130-17682a857115 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.157728 May 18 17:11:45.273284 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 279/543] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:45 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:45.582039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-22162b13-9ac6-4765-aeb1-2d4356469a17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:45.582737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-22162b13-9ac6-4765-aeb1-2d4356469a17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:45.589913 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-22162b13-9ac6-4765-aeb1-2d4356469a17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:45.590614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-22162b13-9ac6-4765-aeb1-2d4356469a17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:45.591375 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-22162b13-9ac6-4765-aeb1-2d4356469a17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:45.591811 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-22162b13-9ac6-4765-aeb1-2d4356469a17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:45.724679 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-22162b13-9ac6-4765-aeb1-2d4356469a17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:45.733111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-22162b13-9ac6-4765-aeb1-2d4356469a17 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.155163 May 18 17:11:45.733703 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 265/544] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:45 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:45.904777 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e8822d7e-32b3-4299-afdc-4c5fa7f09782 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:45.905252 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e8822d7e-32b3-4299-afdc-4c5fa7f09782 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:45.911664 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e8822d7e-32b3-4299-afdc-4c5fa7f09782 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:45.912112 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e8822d7e-32b3-4299-afdc-4c5fa7f09782 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:45.912877 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e8822d7e-32b3-4299-afdc-4c5fa7f09782 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:45.913311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e8822d7e-32b3-4299-afdc-4c5fa7f09782 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:45.936223 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-e8822d7e-32b3-4299-afdc-4c5fa7f09782 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lazy-loading 'flavor' on Instance uuid d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:11:46.009489 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e8822d7e-32b3-4299-afdc-4c5fa7f09782 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "POST /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee/action" status: 202 len: 0 microversion: 2.1 time: 0.108613 May 18 17:11:46.010122 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 280/545] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:11:45 2022] POST /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:11:46.018301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4a3b6f96-60f5-48e8-a9da-589c8bf1a235 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:46.018914 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4a3b6f96-60f5-48e8-a9da-589c8bf1a235 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:46.025284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a3b6f96-60f5-48e8-a9da-589c8bf1a235 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:46.025759 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a3b6f96-60f5-48e8-a9da-589c8bf1a235 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:46.026533 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a3b6f96-60f5-48e8-a9da-589c8bf1a235 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:46.026971 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4a3b6f96-60f5-48e8-a9da-589c8bf1a235 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:46.161229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4a3b6f96-60f5-48e8-a9da-589c8bf1a235 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:46.169050 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4a3b6f96-60f5-48e8-a9da-589c8bf1a235 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.154528 May 18 17:11:46.169623 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 266/546] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:46 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:46.292439 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:46.293137 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:46.299386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:46.299839 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:46.300592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:46.301027 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:46.430300 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:46.439283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:46.440798 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:46.442051 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-97807345-aad7-44b7-8359-794f736f5eeb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.154269 May 18 17:11:46.442736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 281/547] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:46 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:46.751000 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1b8c6b18-6164-4ff7-98ef-84756c248966 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:46.751798 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1b8c6b18-6164-4ff7-98ef-84756c248966 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:46.760499 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b8c6b18-6164-4ff7-98ef-84756c248966 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:46.760954 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b8c6b18-6164-4ff7-98ef-84756c248966 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:46.761756 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b8c6b18-6164-4ff7-98ef-84756c248966 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:46.762206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1b8c6b18-6164-4ff7-98ef-84756c248966 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:46.896823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1b8c6b18-6164-4ff7-98ef-84756c248966 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:46.904716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1b8c6b18-6164-4ff7-98ef-84756c248966 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.157664 May 18 17:11:46.905283 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 267/548] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:46 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:47.188093 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c6a344fc-5541-4d90-b2f4-fbcf98d27647 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:47.188703 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c6a344fc-5541-4d90-b2f4-fbcf98d27647 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:47.194843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6a344fc-5541-4d90-b2f4-fbcf98d27647 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:47.195293 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6a344fc-5541-4d90-b2f4-fbcf98d27647 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:47.196051 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6a344fc-5541-4d90-b2f4-fbcf98d27647 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:47.196489 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c6a344fc-5541-4d90-b2f4-fbcf98d27647 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:47.328408 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c6a344fc-5541-4d90-b2f4-fbcf98d27647 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:47.336827 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c6a344fc-5541-4d90-b2f4-fbcf98d27647 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.152604 May 18 17:11:47.337387 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 282/549] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:47 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:47.462033 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:47.462641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:47.469036 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:47.469489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:47.470284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:47.470720 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:47.602053 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:47.611031 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:47.612004 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:47.613159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-960d83b7-a2a8-4897-a1d6-92dafc7fe9b6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.156245 May 18 17:11:47.613748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 268/550] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:47 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:47.922265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cfdf9065-1e6c-4e94-ab7b-9a8c25c87bf6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:47.922893 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cfdf9065-1e6c-4e94-ab7b-9a8c25c87bf6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:47.929851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfdf9065-1e6c-4e94-ab7b-9a8c25c87bf6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:47.930302 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfdf9065-1e6c-4e94-ab7b-9a8c25c87bf6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:47.931072 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfdf9065-1e6c-4e94-ab7b-9a8c25c87bf6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:47.931514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cfdf9065-1e6c-4e94-ab7b-9a8c25c87bf6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:48.062816 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cfdf9065-1e6c-4e94-ab7b-9a8c25c87bf6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:48.072217 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cfdf9065-1e6c-4e94-ab7b-9a8c25c87bf6 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.153860 May 18 17:11:48.072799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 283/551] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:47 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:48.354931 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e39e37fd-5703-4095-b908-79016bd657ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:48.355487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e39e37fd-5703-4095-b908-79016bd657ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:48.362066 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e39e37fd-5703-4095-b908-79016bd657ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:48.362567 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e39e37fd-5703-4095-b908-79016bd657ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:48.363332 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e39e37fd-5703-4095-b908-79016bd657ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:48.363821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e39e37fd-5703-4095-b908-79016bd657ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:48.501586 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e39e37fd-5703-4095-b908-79016bd657ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:48.511335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e39e37fd-5703-4095-b908-79016bd657ae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.160100 May 18 17:11:48.512185 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 269/552] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:48 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:48.631009 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:48.631553 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:48.637970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:48.638412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:48.639161 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:48.639592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:48.769733 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:48.778431 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:48.780030 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:48.781278 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e0700dea-8947-4ae4-b013-0a01be30b49e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.154770 May 18 17:11:48.781868 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 284/553] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:48 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:49.088378 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2055c75c-629c-44d2-9dd0-eae189037547 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:49.089012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2055c75c-629c-44d2-9dd0-eae189037547 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:49.095340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2055c75c-629c-44d2-9dd0-eae189037547 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:49.095796 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2055c75c-629c-44d2-9dd0-eae189037547 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:49.096568 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2055c75c-629c-44d2-9dd0-eae189037547 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:49.097006 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2055c75c-629c-44d2-9dd0-eae189037547 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:49.234582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2055c75c-629c-44d2-9dd0-eae189037547 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:49.243541 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2055c75c-629c-44d2-9dd0-eae189037547 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.158931 May 18 17:11:49.244111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 270/554] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:49 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:49.529915 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4576d52b-284a-49d2-8198-dee4a7d43d13 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:49.530525 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4576d52b-284a-49d2-8198-dee4a7d43d13 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:49.536880 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4576d52b-284a-49d2-8198-dee4a7d43d13 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:49.537324 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4576d52b-284a-49d2-8198-dee4a7d43d13 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:49.538104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4576d52b-284a-49d2-8198-dee4a7d43d13 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:49.538538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4576d52b-284a-49d2-8198-dee4a7d43d13 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:49.672886 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4576d52b-284a-49d2-8198-dee4a7d43d13 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:49.681934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4576d52b-284a-49d2-8198-dee4a7d43d13 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.155820 May 18 17:11:49.682551 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 285/555] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:49 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:49.800218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:49.800792 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:49.808033 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:49.808476 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:49.809221 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:49.809648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:49.945802 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:49.954529 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:49.956029 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:49.957188 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cd3bec62-43d4-4e3d-83e0-9cb2dfc4f2e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.160967 May 18 17:11:49.957800 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 271/556] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:49 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:50.260405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d4111677-e5c9-47b8-a578-9016e310795c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:50.261015 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d4111677-e5c9-47b8-a578-9016e310795c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:50.267095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4111677-e5c9-47b8-a578-9016e310795c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:50.267545 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4111677-e5c9-47b8-a578-9016e310795c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:50.268307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4111677-e5c9-47b8-a578-9016e310795c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:50.268742 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4111677-e5c9-47b8-a578-9016e310795c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:50.397698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d4111677-e5c9-47b8-a578-9016e310795c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:50.405885 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d4111677-e5c9-47b8-a578-9016e310795c tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1726 microversion: 2.1 time: 0.149309 May 18 17:11:50.406455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 286/557] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:50 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1726 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:50.699201 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-96408aa5-ceef-4667-992d-4e6ae8314003 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:50.699804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-96408aa5-ceef-4667-992d-4e6ae8314003 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:50.706492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96408aa5-ceef-4667-992d-4e6ae8314003 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:50.706934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96408aa5-ceef-4667-992d-4e6ae8314003 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:50.708350 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96408aa5-ceef-4667-992d-4e6ae8314003 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:50.708987 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96408aa5-ceef-4667-992d-4e6ae8314003 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:50.724389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:50.861131 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96408aa5-ceef-4667-992d-4e6ae8314003 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:50.868963 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-96408aa5-ceef-4667-992d-4e6ae8314003 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.173611 May 18 17:11:50.869562 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 272/558] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:50 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:50.976220 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:50.976781 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:50.983396 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:50.983839 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:50.984611 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:50.985044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:51.121412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:51.130717 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:51.132222 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:51.133368 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d1ad7502-47d5-4f27-bd3d-5589a2594f88 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.161822 May 18 17:11:51.133960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 287/559] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:50 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:51.425175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ea72850c-d001-417e-b1de-8228016a00a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:51.425956 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ea72850c-d001-417e-b1de-8228016a00a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:51.433353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ea72850c-d001-417e-b1de-8228016a00a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:51.433887 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ea72850c-d001-417e-b1de-8228016a00a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:51.434970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ea72850c-d001-417e-b1de-8228016a00a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:51.435455 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ea72850c-d001-417e-b1de-8228016a00a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:51.578185 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ea72850c-d001-417e-b1de-8228016a00a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:51.586845 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ea72850c-d001-417e-b1de-8228016a00a4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1732 microversion: 2.1 time: 0.166997 May 18 17:11:51.587711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 273/560] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:51 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:11:51.606727 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-aa59d096-fa1f-4570-9908-d095a016fe3f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:51.607481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-aa59d096-fa1f-4570-9908-d095a016fe3f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:51.616413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa59d096-fa1f-4570-9908-d095a016fe3f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:51.617101 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa59d096-fa1f-4570-9908-d095a016fe3f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:51.618317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa59d096-fa1f-4570-9908-d095a016fe3f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:51.618989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa59d096-fa1f-4570-9908-d095a016fe3f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:51.624794 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:11:51.747152 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-aa59d096-fa1f-4570-9908-d095a016fe3f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.146572 May 18 17:11:51.747745 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 288/561] 10.222.0.49 () {58 vars in 1274 bytes} [Wed May 18 17:11:51 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-interface => generated 285 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:11:51.886733 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c4f150b0-d781-4e7e-ab4c-ff3218ceec2d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:51.887296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c4f150b0-d781-4e7e-ab4c-ff3218ceec2d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:51.894670 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4f150b0-d781-4e7e-ab4c-ff3218ceec2d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:51.895249 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4f150b0-d781-4e7e-ab4c-ff3218ceec2d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:51.896111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4f150b0-d781-4e7e-ab4c-ff3218ceec2d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:51.896616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4f150b0-d781-4e7e-ab4c-ff3218ceec2d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:52.148558 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c4f150b0-d781-4e7e-ab4c-ff3218ceec2d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:52.152819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:52.153443 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:52.156648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c4f150b0-d781-4e7e-ab4c-ff3218ceec2d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.273796 May 18 17:11:52.165981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 274/562] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:51 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:52.166225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:52.166225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:52.166225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:52.166225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:52.304588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:52.313594 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:52.315123 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:52.316322 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dfd26503-6765-4bbc-a70a-814800b1b121 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.168889 May 18 17:11:52.317539 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 289/563] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:52 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:52.984502 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-2d5ef3a2-3e0f-4107-8148-70ce22c6b09e req-deca249d-540b-4f71-ad19-c2a898f17a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547563fc-2b40-4782-be59-1e1dfcbae2e9", "tag": "97903cf8-6adc-4750-9dcb-7e5cd03b095f"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:52.995063 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-2d5ef3a2-3e0f-4107-8148-70ce22c6b09e req-deca249d-540b-4f71-ad19-c2a898f17a95 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:52.995507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-2d5ef3a2-3e0f-4107-8148-70ce22c6b09e req-deca249d-540b-4f71-ad19-c2a898f17a95 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:53.015806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-2d5ef3a2-3e0f-4107-8148-70ce22c6b09e req-deca249d-540b-4f71-ad19-c2a898f17a95 service nova] Creating event network-changed:97903cf8-6adc-4750-9dcb-7e5cd03b095f for instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 on hv-cinder-79578 May 18 17:11:53.023911 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-2d5ef3a2-3e0f-4107-8148-70ce22c6b09e req-deca249d-540b-4f71-ad19-c2a898f17a95 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107687 May 18 17:11:53.028343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 275/564] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:11:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:11:53.174329 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2f2bf55c-9d44-49b6-b3cd-7d4bcffa1ded tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:53.174953 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2f2bf55c-9d44-49b6-b3cd-7d4bcffa1ded tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:53.182332 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55c-9d44-49b6-b3cd-7d4bcffa1ded tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:53.183121 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55c-9d44-49b6-b3cd-7d4bcffa1ded tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:53.183906 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55c-9d44-49b6-b3cd-7d4bcffa1ded tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:53.184342 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2f2bf55c-9d44-49b6-b3cd-7d4bcffa1ded tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:53.335979 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:53.337225 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:53.348293 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:53.349327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:53.350779 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:53.351572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:53.425545 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2f2bf55c-9d44-49b6-b3cd-7d4bcffa1ded tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:53.438732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2f2bf55c-9d44-49b6-b3cd-7d4bcffa1ded tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.268266 May 18 17:11:53.439644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 290/565] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:53 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:53.510498 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:53.519020 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:53.520836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:53.522041 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fc83c1f5-f0bc-4a5d-90d2-c019ffcbbc0b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.190569 May 18 17:11:53.522599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 276/566] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:53 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:54.455290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-28b26883-77a5-4700-aca8-19e6bd720dfa tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:54.455903 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-28b26883-77a5-4700-aca8-19e6bd720dfa tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:54.463180 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28b26883-77a5-4700-aca8-19e6bd720dfa tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:54.463660 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28b26883-77a5-4700-aca8-19e6bd720dfa tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:54.464537 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28b26883-77a5-4700-aca8-19e6bd720dfa tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:54.464977 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-28b26883-77a5-4700-aca8-19e6bd720dfa tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:54.540454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:54.541052 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:54.547710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:54.548159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:54.549473 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:54.549473 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:54.599735 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-28b26883-77a5-4700-aca8-19e6bd720dfa tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:54.607359 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-28b26883-77a5-4700-aca8-19e6bd720dfa tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.155889 May 18 17:11:54.607934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 291/567] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:54 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:54.681445 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:54.689911 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:54.691417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:54.693394 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ed80405e-7b23-42ac-97a0-86b4e83886e0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.156991 May 18 17:11:54.693993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 277/568] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:54 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:55.042362 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-328b6512-8769-497d-bdc3-3f00dd0df3a5 req-bb80e9c1-100e-4fa9-8da7-849c2e4a6acc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547563fc-2b40-4782-be59-1e1dfcbae2e9", "tag": "97903cf8-6adc-4750-9dcb-7e5cd03b095f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:11:55.050406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-328b6512-8769-497d-bdc3-3f00dd0df3a5 req-bb80e9c1-100e-4fa9-8da7-849c2e4a6acc service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:55.050846 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-328b6512-8769-497d-bdc3-3f00dd0df3a5 req-bb80e9c1-100e-4fa9-8da7-849c2e4a6acc service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:55.062514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-328b6512-8769-497d-bdc3-3f00dd0df3a5 req-bb80e9c1-100e-4fa9-8da7-849c2e4a6acc service nova] Creating event network-changed:97903cf8-6adc-4750-9dcb-7e5cd03b095f for instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 on hv-cinder-79578 May 18 17:11:55.067814 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-328b6512-8769-497d-bdc3-3f00dd0df3a5 req-bb80e9c1-100e-4fa9-8da7-849c2e4a6acc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028937 May 18 17:11:55.068686 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 292/569] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:11:55.624208 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e0841bb7-b3a9-41c0-a236-b1dd5585a40d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:55.624823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e0841bb7-b3a9-41c0-a236-b1dd5585a40d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:55.632371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0841bb7-b3a9-41c0-a236-b1dd5585a40d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:55.632873 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0841bb7-b3a9-41c0-a236-b1dd5585a40d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:55.633650 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0841bb7-b3a9-41c0-a236-b1dd5585a40d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:55.634140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0841bb7-b3a9-41c0-a236-b1dd5585a40d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:55.712883 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:55.713734 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:55.720065 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:55.720517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:55.721282 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:55.721735 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:55.778489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e0841bb7-b3a9-41c0-a236-b1dd5585a40d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:55.786097 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e0841bb7-b3a9-41c0-a236-b1dd5585a40d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.165639 May 18 17:11:55.786670 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 278/570] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:55 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:55.943068 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:55.952678 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:55.954220 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:55.955390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-25e90887-c8fd-4011-bd04-a605f1f7f48f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.247573 May 18 17:11:55.956114 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 293/571] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:55 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:11:56.461523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8832f8cc-ed0c-4a2b-9b1e-5a233e299ac4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:56.462102 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8832f8cc-ed0c-4a2b-9b1e-5a233e299ac4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:56.468457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8832f8cc-ed0c-4a2b-9b1e-5a233e299ac4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:56.468913 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8832f8cc-ed0c-4a2b-9b1e-5a233e299ac4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:56.469706 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8832f8cc-ed0c-4a2b-9b1e-5a233e299ac4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:56.470145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8832f8cc-ed0c-4a2b-9b1e-5a233e299ac4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:56.550741 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-8832f8cc-ed0c-4a2b-9b1e-5a233e299ac4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lazy-loading 'services' on Instance uuid 457f8f5f-ff7d-4484-8e29-298c7ecbee76 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:11:56.665785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8832f8cc-ed0c-4a2b-9b1e-5a233e299ac4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/os-volume_attachments/67eea5c6-4fd5-42d3-87b1-63b8324a2c8a" status: 202 len: 0 microversion: 2.1 time: 0.307609 May 18 17:11:56.666489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 279/572] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:11:56 2022] DELETE /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/os-volume_attachments/67eea5c6-4fd5-42d3-87b1-63b8324a2c8a => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:11:56.803559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0153fc0d-e556-45df-a6b6-0928d5f6a64e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:56.804148 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0153fc0d-e556-45df-a6b6-0928d5f6a64e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:56.810653 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0153fc0d-e556-45df-a6b6-0928d5f6a64e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:56.811098 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0153fc0d-e556-45df-a6b6-0928d5f6a64e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:56.811852 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0153fc0d-e556-45df-a6b6-0928d5f6a64e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:56.812282 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0153fc0d-e556-45df-a6b6-0928d5f6a64e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:56.942693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0153fc0d-e556-45df-a6b6-0928d5f6a64e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:56.951075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0153fc0d-e556-45df-a6b6-0928d5f6a64e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.151982 May 18 17:11:56.951638 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 294/573] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:56 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:11:56.975504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:56.976207 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:56.982399 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:56.982852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:56.983620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:56.984060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:57.114613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:57.124103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:57.125543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:57.126833 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fe1db073-8426-4ee0-8e78-4221938ebaba tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.155964 May 18 17:11:57.127293 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 280/574] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:56 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:57.968544 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-47654a06-807e-4fc8-9415-e7bd80270cc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:57.969185 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-47654a06-807e-4fc8-9415-e7bd80270cc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:57.975999 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47654a06-807e-4fc8-9415-e7bd80270cc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:57.976454 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47654a06-807e-4fc8-9415-e7bd80270cc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:57.977294 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47654a06-807e-4fc8-9415-e7bd80270cc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:57.977722 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47654a06-807e-4fc8-9415-e7bd80270cc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:58.115170 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-47654a06-807e-4fc8-9415-e7bd80270cc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:58.122779 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-47654a06-807e-4fc8-9415-e7bd80270cc9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.158398 May 18 17:11:58.123340 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 295/575] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:57 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:11:58.146056 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:58.147323 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:58.153888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:58.154334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:58.155093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:58.155518 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:58.285938 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:58.294523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:58.296015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:58.297171 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e5ef2a4b-9145-4ec0-a1b7-50467a0865b7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.154965 May 18 17:11:58.297740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 281/576] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:58 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:11:59.139295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5fec003b-79f1-46e3-8b75-522ba928ab0e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:59.139914 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5fec003b-79f1-46e3-8b75-522ba928ab0e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:59.146084 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fec003b-79f1-46e3-8b75-522ba928ab0e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:59.147050 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fec003b-79f1-46e3-8b75-522ba928ab0e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:59.147904 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fec003b-79f1-46e3-8b75-522ba928ab0e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:59.148341 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5fec003b-79f1-46e3-8b75-522ba928ab0e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:59.284304 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5fec003b-79f1-46e3-8b75-522ba928ab0e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:59.291919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5fec003b-79f1-46e3-8b75-522ba928ab0e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.156733 May 18 17:11:59.292534 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 296/577] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:11:59 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:11:59.315457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:11:59.316062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:11:59.323531 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:59.323917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:59.324682 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:11:59.325171 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:11:59.477806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:59.486151 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:59.487659 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:11:59.488808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-202863ae-5a37-4b8c-b4cf-7ebdf6a2a64a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.177176 May 18 17:11:59.489366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 282/578] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:11:59 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:12:00.309373 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f1ce88cd-b915-47e0-be4f-40b5685440be tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:00.310019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f1ce88cd-b915-47e0-be4f-40b5685440be tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:00.316771 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1ce88cd-b915-47e0-be4f-40b5685440be tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:00.317221 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1ce88cd-b915-47e0-be4f-40b5685440be tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:00.318009 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1ce88cd-b915-47e0-be4f-40b5685440be tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:00.318736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f1ce88cd-b915-47e0-be4f-40b5685440be tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:00.453053 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f1ce88cd-b915-47e0-be4f-40b5685440be tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:00.460956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f1ce88cd-b915-47e0-be4f-40b5685440be tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.155443 May 18 17:12:00.461526 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 297/579] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:00 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:00.508637 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:00.509285 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:00.515969 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:00.516424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:00.517194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:00.517629 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:00.649037 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:00.657554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:00.659191 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:00.660451 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3d0a5baa-b77c-45ad-b9f0-648d13d5602c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.156085 May 18 17:12:00.661010 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 283/580] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:12:00 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:12:00.944320 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d0252707-0fae-44cf-8020-aaa192d08695 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:00.946351 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=62 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:00.951803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d0252707-0fae-44cf-8020-aaa192d08695 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:00.952256 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d0252707-0fae-44cf-8020-aaa192d08695 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:01.012321 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d0252707-0fae-44cf-8020-aaa192d08695 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Going to try to stop instance {{(pid=117731) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 18 17:12:01.058154 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d0252707-0fae-44cf-8020-aaa192d08695 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/action" status: 202 len: 0 microversion: 2.1 time: 0.117426 May 18 17:12:01.059292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 298/581] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:12:00 2022] POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:12:01.067739 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4735098f-300b-4177-902e-756302bb0ac6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:01.068823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4735098f-300b-4177-902e-756302bb0ac6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:01.075984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4735098f-300b-4177-902e-756302bb0ac6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:01.076696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4735098f-300b-4177-902e-756302bb0ac6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:01.078129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4735098f-300b-4177-902e-756302bb0ac6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:01.079084 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4735098f-300b-4177-902e-756302bb0ac6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:01.233743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4735098f-300b-4177-902e-756302bb0ac6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:01.242456 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4735098f-300b-4177-902e-756302bb0ac6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.178763 May 18 17:12:01.243039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 284/582] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:01 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:01.479919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e191bfd9-3da9-47c9-8ac7-6d8a4e24d81f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:01.480530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e191bfd9-3da9-47c9-8ac7-6d8a4e24d81f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:01.487439 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e191bfd9-3da9-47c9-8ac7-6d8a4e24d81f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:01.487894 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e191bfd9-3da9-47c9-8ac7-6d8a4e24d81f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:01.488704 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e191bfd9-3da9-47c9-8ac7-6d8a4e24d81f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:01.489135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e191bfd9-3da9-47c9-8ac7-6d8a4e24d81f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:01.627366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e191bfd9-3da9-47c9-8ac7-6d8a4e24d81f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:01.635841 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e191bfd9-3da9-47c9-8ac7-6d8a4e24d81f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.160350 May 18 17:12:01.636425 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 299/583] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:01 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:01.679545 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:01.680247 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:01.686981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:01.687457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:01.688223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:01.688663 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:01.828469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:01.842416 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:01.843984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:01.845167 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8a7d15d8-0011-404b-81d6-87c97034cd42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.169618 May 18 17:12:01.845835 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 285/584] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:12:01 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:12:02.260138 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-806058ff-2619-4d1e-9918-c9f9f20b5649 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:02.260872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-806058ff-2619-4d1e-9918-c9f9f20b5649 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:02.266919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-806058ff-2619-4d1e-9918-c9f9f20b5649 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:02.267472 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-806058ff-2619-4d1e-9918-c9f9f20b5649 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:02.268152 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-806058ff-2619-4d1e-9918-c9f9f20b5649 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:02.268625 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-806058ff-2619-4d1e-9918-c9f9f20b5649 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:02.367972 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-5d58b6a7-9449-4c3d-b8fb-93f294470acf req-c6bc3785-acb4-444a-ba8c-56319b6a663d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9559237-c858-41a6-ba99-09106ba78496", "name": "network-vif-plugged", "status": "completed", "tag": "a59f32ad-7870-4083-b0d4-262a85cedd52"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:02.381361 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-5d58b6a7-9449-4c3d-b8fb-93f294470acf req-c6bc3785-acb4-444a-ba8c-56319b6a663d service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:02.382012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-5d58b6a7-9449-4c3d-b8fb-93f294470acf req-c6bc3785-acb4-444a-ba8c-56319b6a663d service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:02.393620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-5d58b6a7-9449-4c3d-b8fb-93f294470acf req-c6bc3785-acb4-444a-ba8c-56319b6a663d service nova] Creating event network-vif-plugged:a59f32ad-7870-4083-b0d4-262a85cedd52 for instance e9559237-c858-41a6-ba99-09106ba78496 on hv-cinder-79578 May 18 17:12:02.399576 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-5d58b6a7-9449-4c3d-b8fb-93f294470acf req-c6bc3785-acb4-444a-ba8c-56319b6a663d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107229 May 18 17:12:02.400141 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 286/585] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:12:02.411487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-806058ff-2619-4d1e-9918-c9f9f20b5649 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:02.419941 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-806058ff-2619-4d1e-9918-c9f9f20b5649 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.164219 May 18 17:12:02.420518 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 300/586] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:02 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:02.653711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a9668e19-9441-4adf-819a-bd011b83e8c5 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:02.654336 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a9668e19-9441-4adf-819a-bd011b83e8c5 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:02.660608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9668e19-9441-4adf-819a-bd011b83e8c5 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:02.661043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9668e19-9441-4adf-819a-bd011b83e8c5 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:02.661842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9668e19-9441-4adf-819a-bd011b83e8c5 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:02.662286 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9668e19-9441-4adf-819a-bd011b83e8c5 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:02.801059 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a9668e19-9441-4adf-819a-bd011b83e8c5 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:02.810141 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a9668e19-9441-4adf-819a-bd011b83e8c5 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.160586 May 18 17:12:02.810723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 287/587] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:02 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:02.867442 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:02.868058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:02.875067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:02.875587 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:02.876412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:02.876882 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:03.038971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:03.048349 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:03.049879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:03.051061 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-22a08dab-448c-4c6a-a9cd-3186371d065a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.189042 May 18 17:12:03.051635 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 301/588] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:12:02 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:12:03.437793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-27218de1-06be-427a-b703-7a999649104f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:03.438394 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-27218de1-06be-427a-b703-7a999649104f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:03.444436 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-27218de1-06be-427a-b703-7a999649104f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:03.444877 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-27218de1-06be-427a-b703-7a999649104f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:03.445624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-27218de1-06be-427a-b703-7a999649104f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:03.446071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-27218de1-06be-427a-b703-7a999649104f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:03.581644 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-27218de1-06be-427a-b703-7a999649104f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:03.590689 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-27218de1-06be-427a-b703-7a999649104f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.156473 May 18 17:12:03.591264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 288/589] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:03 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:03.827263 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-38d1783f-c89e-422c-ac3e-9d4c4a842541 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:03.827795 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-38d1783f-c89e-422c-ac3e-9d4c4a842541 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:03.835637 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-38d1783f-c89e-422c-ac3e-9d4c4a842541 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:03.836096 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-38d1783f-c89e-422c-ac3e-9d4c4a842541 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:03.836876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-38d1783f-c89e-422c-ac3e-9d4c4a842541 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:03.837320 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-38d1783f-c89e-422c-ac3e-9d4c4a842541 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:03.976661 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-38d1783f-c89e-422c-ac3e-9d4c4a842541 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:03.984278 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-38d1783f-c89e-422c-ac3e-9d4c4a842541 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.160961 May 18 17:12:03.984849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 302/590] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:03 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:04.072127 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:04.072730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:04.079447 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:04.079813 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:04.080586 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:04.081012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:04.220220 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:04.222642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:04.230918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:04.232422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:04.233636 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dcfbb786-7b52-4d3c-b198-d3b54b120da3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.165481 May 18 17:12:04.234300 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 289/591] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:12:04 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:12:04.608469 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4031f2da-43d4-4c6f-bb23-e2e18baf63aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:04.609087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4031f2da-43d4-4c6f-bb23-e2e18baf63aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:04.615691 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4031f2da-43d4-4c6f-bb23-e2e18baf63aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:04.616134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4031f2da-43d4-4c6f-bb23-e2e18baf63aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:04.616902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4031f2da-43d4-4c6f-bb23-e2e18baf63aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:04.617329 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4031f2da-43d4-4c6f-bb23-e2e18baf63aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:04.752291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4031f2da-43d4-4c6f-bb23-e2e18baf63aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:04.761003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4031f2da-43d4-4c6f-bb23-e2e18baf63aa tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.156368 May 18 17:12:04.761585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 303/592] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:04 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:05.002464 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6335e745-00b2-411e-a780-40227b8fcf5c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:05.003072 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6335e745-00b2-411e-a780-40227b8fcf5c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:05.010361 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6335e745-00b2-411e-a780-40227b8fcf5c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:05.010809 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6335e745-00b2-411e-a780-40227b8fcf5c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:05.011581 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6335e745-00b2-411e-a780-40227b8fcf5c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:05.012016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6335e745-00b2-411e-a780-40227b8fcf5c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:05.155780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6335e745-00b2-411e-a780-40227b8fcf5c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:05.163816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6335e745-00b2-411e-a780-40227b8fcf5c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.165781 May 18 17:12:05.164398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 290/593] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:04 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:05.253481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:05.254209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:05.262471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:05.263007 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:05.263796 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:05.264699 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:05.410323 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:05.413645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:05.422360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:05.423596 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:05.424690 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-64fc6452-8a08-44c3-a8c3-e6caf96947e9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1808 microversion: 2.20 time: 0.176174 May 18 17:12:05.425244 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 304/594] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:12:05 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:12:05.779884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c3455797-703f-45d4-897d-42ddea71a267 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:05.780984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c3455797-703f-45d4-897d-42ddea71a267 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:05.789711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3455797-703f-45d4-897d-42ddea71a267 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:05.790196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3455797-703f-45d4-897d-42ddea71a267 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:05.791006 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3455797-703f-45d4-897d-42ddea71a267 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:05.791500 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3455797-703f-45d4-897d-42ddea71a267 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:05.940641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c3455797-703f-45d4-897d-42ddea71a267 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:05.948995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c3455797-703f-45d4-897d-42ddea71a267 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.173203 May 18 17:12:05.949577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 291/595] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:05 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:12:06.182663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c188ba2c-ca69-4498-a607-6b686a2992c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:06.183288 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c188ba2c-ca69-4498-a607-6b686a2992c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:06.190949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c188ba2c-ca69-4498-a607-6b686a2992c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:06.191455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c188ba2c-ca69-4498-a607-6b686a2992c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:06.192603 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c188ba2c-ca69-4498-a607-6b686a2992c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:06.193326 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c188ba2c-ca69-4498-a607-6b686a2992c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:06.443841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:06.444579 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:06.451398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:06.451931 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:06.452711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:06.453147 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:06.590156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c188ba2c-ca69-4498-a607-6b686a2992c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:06.601228 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c188ba2c-ca69-4498-a607-6b686a2992c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.422881 May 18 17:12:06.602041 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 305/596] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:06 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:06.602515 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:06.612573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:06.614119 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:06.615643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-841cdb04-2921-4032-8cf9-bab8dbc5f8cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1795 microversion: 2.20 time: 0.176610 May 18 17:12:06.616351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 292/597] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:12:06 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1795 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:12:06.968848 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e7679a11-088e-4e00-8abc-f89d2685014e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:06.969457 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e7679a11-088e-4e00-8abc-f89d2685014e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:06.975638 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e7679a11-088e-4e00-8abc-f89d2685014e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:06.976088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e7679a11-088e-4e00-8abc-f89d2685014e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:06.976859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e7679a11-088e-4e00-8abc-f89d2685014e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:06.977295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e7679a11-088e-4e00-8abc-f89d2685014e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:07.118596 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e7679a11-088e-4e00-8abc-f89d2685014e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:07.126284 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e7679a11-088e-4e00-8abc-f89d2685014e tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.161520 May 18 17:12:07.126869 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 306/598] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:06 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:07.619511 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-48aa86ed-6f31-42fd-b8c6-8cd488222d25 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:07.620123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-48aa86ed-6f31-42fd-b8c6-8cd488222d25 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:07.626083 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48aa86ed-6f31-42fd-b8c6-8cd488222d25 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:07.626531 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48aa86ed-6f31-42fd-b8c6-8cd488222d25 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:07.627289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48aa86ed-6f31-42fd-b8c6-8cd488222d25 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:07.627719 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48aa86ed-6f31-42fd-b8c6-8cd488222d25 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:07.769282 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-48aa86ed-6f31-42fd-b8c6-8cd488222d25 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:07.777161 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-48aa86ed-6f31-42fd-b8c6-8cd488222d25 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.162550 May 18 17:12:07.777753 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 293/599] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:07 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:08.144650 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6aac28b8-195a-4deb-9009-3613765e0409 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:08.145265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6aac28b8-195a-4deb-9009-3613765e0409 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:08.152539 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6aac28b8-195a-4deb-9009-3613765e0409 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:08.153004 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6aac28b8-195a-4deb-9009-3613765e0409 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:08.153788 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6aac28b8-195a-4deb-9009-3613765e0409 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:08.154221 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6aac28b8-195a-4deb-9009-3613765e0409 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:08.293419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6aac28b8-195a-4deb-9009-3613765e0409 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:08.300903 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6aac28b8-195a-4deb-9009-3613765e0409 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.160388 May 18 17:12:08.301467 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 307/600] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:08 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:08.794320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9479d6a8-898e-4164-b373-e14cd9e20f7b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:08.795080 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9479d6a8-898e-4164-b373-e14cd9e20f7b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:08.801869 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9479d6a8-898e-4164-b373-e14cd9e20f7b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:08.803304 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9479d6a8-898e-4164-b373-e14cd9e20f7b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:08.803642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9479d6a8-898e-4164-b373-e14cd9e20f7b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:08.804082 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9479d6a8-898e-4164-b373-e14cd9e20f7b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:08.954614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9479d6a8-898e-4164-b373-e14cd9e20f7b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:08.963430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9479d6a8-898e-4164-b373-e14cd9e20f7b tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1508 microversion: 2.1 time: 0.172985 May 18 17:12:08.964021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 294/601] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:08 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:08.991262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1552cd8b-9421-4bdf-8d21-c2bc32f478fd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:08.991845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1552cd8b-9421-4bdf-8d21-c2bc32f478fd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:08.998289 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1552cd8b-9421-4bdf-8d21-c2bc32f478fd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:08.998736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1552cd8b-9421-4bdf-8d21-c2bc32f478fd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:08.999521 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1552cd8b-9421-4bdf-8d21-c2bc32f478fd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:08.999961 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1552cd8b-9421-4bdf-8d21-c2bc32f478fd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:09.097861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1552cd8b-9421-4bdf-8d21-c2bc32f478fd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "POST /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee/action" status: 202 len: 0 microversion: 2.1 time: 0.111059 May 18 17:12:09.098485 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 308/602] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:12:08 2022] POST /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:12:09.107058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5786941b-e369-4668-b3f6-fb93fabb358c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:09.107686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5786941b-e369-4668-b3f6-fb93fabb358c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:09.115464 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5786941b-e369-4668-b3f6-fb93fabb358c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:09.116146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5786941b-e369-4668-b3f6-fb93fabb358c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:09.117058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5786941b-e369-4668-b3f6-fb93fabb358c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:09.117795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5786941b-e369-4668-b3f6-fb93fabb358c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:09.285086 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5786941b-e369-4668-b3f6-fb93fabb358c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:09.293808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5786941b-e369-4668-b3f6-fb93fabb358c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1516 microversion: 2.1 time: 0.190588 May 18 17:12:09.294401 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 295/603] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:09 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1516 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:09.320687 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3b3a455c-9327-4f2a-85ac-9fc04470e746 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:09.321492 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3b3a455c-9327-4f2a-85ac-9fc04470e746 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:09.327780 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b3a455c-9327-4f2a-85ac-9fc04470e746 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:09.328229 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b3a455c-9327-4f2a-85ac-9fc04470e746 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:09.329012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b3a455c-9327-4f2a-85ac-9fc04470e746 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:09.329449 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b3a455c-9327-4f2a-85ac-9fc04470e746 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:09.485263 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3b3a455c-9327-4f2a-85ac-9fc04470e746 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:09.493683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3b3a455c-9327-4f2a-85ac-9fc04470e746 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.177998 May 18 17:12:09.494275 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 309/604] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:09 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:12:10.259573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-005a372f-1d4d-4a85-b45c-281d2e9b6406 req-a2bdc412-d9ef-4c9a-8364-731963d9a246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee", "name": "network-vif-unplugged", "status": "completed", "tag": "cac676f2-4e76-4013-9947-99f06f080ac2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:10.269904 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-005a372f-1d4d-4a85-b45c-281d2e9b6406 req-a2bdc412-d9ef-4c9a-8364-731963d9a246 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:10.270348 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-005a372f-1d4d-4a85-b45c-281d2e9b6406 req-a2bdc412-d9ef-4c9a-8364-731963d9a246 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:10.295378 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.compute.server_external_events [req-005a372f-1d4d-4a85-b45c-281d2e9b6406 req-a2bdc412-d9ef-4c9a-8364-731963d9a246 service nova] Unable to find a host for instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee. Dropping event network-vif-unplugged {{(pid=117732) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 18 17:12:10.296289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-005a372f-1d4d-4a85-b45c-281d2e9b6406 req-a2bdc412-d9ef-4c9a-8364-731963d9a246 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.041112 May 18 17:12:10.297371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 296/605] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:12:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 42 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 18 17:12:10.311801 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-64ddc0f9-87a4-4887-950d-0a5defc8be94 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:10.312422 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-64ddc0f9-87a4-4887-950d-0a5defc8be94 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:10.319890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64ddc0f9-87a4-4887-950d-0a5defc8be94 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:10.320339 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64ddc0f9-87a4-4887-950d-0a5defc8be94 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:10.321121 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64ddc0f9-87a4-4887-950d-0a5defc8be94 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:10.321689 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64ddc0f9-87a4-4887-950d-0a5defc8be94 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:10.480382 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-64ddc0f9-87a4-4887-950d-0a5defc8be94 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:10.488727 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-64ddc0f9-87a4-4887-950d-0a5defc8be94 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1518 microversion: 2.1 time: 0.180727 May 18 17:12:10.489307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 310/606] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:10 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:10.513831 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3a3c03f-a5b0-4e9f-bab7-168e04c58f44 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:10.515021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d3a3c03f-a5b0-4e9f-bab7-168e04c58f44 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:10.524285 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3a3c03f-a5b0-4e9f-bab7-168e04c58f44 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:10.525355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3a3c03f-a5b0-4e9f-bab7-168e04c58f44 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:10.526953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3a3c03f-a5b0-4e9f-bab7-168e04c58f44 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:10.527666 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3a3c03f-a5b0-4e9f-bab7-168e04c58f44 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:10.708435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d3a3c03f-a5b0-4e9f-bab7-168e04c58f44 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:10.723339 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d3a3c03f-a5b0-4e9f-bab7-168e04c58f44 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.213753 May 18 17:12:10.724690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 297/607] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:10 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:11.516412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-953ed3fc-2aed-4994-8dc3-08c1e354bce9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:11.517205 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-953ed3fc-2aed-4994-8dc3-08c1e354bce9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:11.524266 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-953ed3fc-2aed-4994-8dc3-08c1e354bce9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:11.524706 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-953ed3fc-2aed-4994-8dc3-08c1e354bce9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:11.525503 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-953ed3fc-2aed-4994-8dc3-08c1e354bce9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:11.525973 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-953ed3fc-2aed-4994-8dc3-08c1e354bce9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:11.742151 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f9fa86e7-5e91-448b-882e-2031ee24f35f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:11.742970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f9fa86e7-5e91-448b-882e-2031ee24f35f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:11.749743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f9fa86e7-5e91-448b-882e-2031ee24f35f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:11.750282 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f9fa86e7-5e91-448b-882e-2031ee24f35f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:11.751139 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f9fa86e7-5e91-448b-882e-2031ee24f35f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:11.751672 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f9fa86e7-5e91-448b-882e-2031ee24f35f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:11.762512 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-953ed3fc-2aed-4994-8dc3-08c1e354bce9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:11.771729 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-953ed3fc-2aed-4994-8dc3-08c1e354bce9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.259065 May 18 17:12:11.772662 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 311/608] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:11 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:11.916236 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f9fa86e7-5e91-448b-882e-2031ee24f35f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:11.924062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f9fa86e7-5e91-448b-882e-2031ee24f35f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.186336 May 18 17:12:11.924523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 298/609] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:11 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:12:12.789175 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d20cd06f-2bdd-48c3-b781-fc8648734c3c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:12.789833 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d20cd06f-2bdd-48c3-b781-fc8648734c3c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:12.797423 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d20cd06f-2bdd-48c3-b781-fc8648734c3c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:12.797913 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d20cd06f-2bdd-48c3-b781-fc8648734c3c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:12.798924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d20cd06f-2bdd-48c3-b781-fc8648734c3c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:12.799511 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d20cd06f-2bdd-48c3-b781-fc8648734c3c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:12.943654 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-512d9cd6-f0ba-435d-a00e-3463491b8dc8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:12.944382 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-512d9cd6-f0ba-435d-a00e-3463491b8dc8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:12.945397 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d20cd06f-2bdd-48c3-b781-fc8648734c3c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:12.947093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=74 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:12.953124 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-512d9cd6-f0ba-435d-a00e-3463491b8dc8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:12.953576 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-512d9cd6-f0ba-435d-a00e-3463491b8dc8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:12.953727 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d20cd06f-2bdd-48c3-b781-fc8648734c3c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.168696 May 18 17:12:12.954270 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 312/610] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:12 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:12.954452 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-512d9cd6-f0ba-435d-a00e-3463491b8dc8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:12.954890 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-512d9cd6-f0ba-435d-a00e-3463491b8dc8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:13.093194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-512d9cd6-f0ba-435d-a00e-3463491b8dc8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:13.101337 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-512d9cd6-f0ba-435d-a00e-3463491b8dc8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.162168 May 18 17:12:13.101947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 299/611] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:12 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:12:13.979878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-162f362d-4b12-40c0-be84-27b1af66f5cc tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:13.980607 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-162f362d-4b12-40c0-be84-27b1af66f5cc tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:13.987485 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-162f362d-4b12-40c0-be84-27b1af66f5cc tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:13.987976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-162f362d-4b12-40c0-be84-27b1af66f5cc tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:13.988769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-162f362d-4b12-40c0-be84-27b1af66f5cc tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:13.989211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-162f362d-4b12-40c0-be84-27b1af66f5cc tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:14.118463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-27db899b-d7d9-4fc7-824b-1661a52d7dde tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:14.119128 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-27db899b-d7d9-4fc7-824b-1661a52d7dde tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:14.126078 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-27db899b-d7d9-4fc7-824b-1661a52d7dde tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:14.126528 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-27db899b-d7d9-4fc7-824b-1661a52d7dde tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:14.127314 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-27db899b-d7d9-4fc7-824b-1661a52d7dde tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:14.127750 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-27db899b-d7d9-4fc7-824b-1661a52d7dde tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:14.142993 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-162f362d-4b12-40c0-be84-27b1af66f5cc tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:14.152311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-162f362d-4b12-40c0-be84-27b1af66f5cc tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.176336 May 18 17:12:14.152910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 313/612] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:13 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:14.273057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-27db899b-d7d9-4fc7-824b-1661a52d7dde tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:14.281470 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-27db899b-d7d9-4fc7-824b-1661a52d7dde tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.166985 May 18 17:12:14.282139 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 300/613] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:14 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:15.170373 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fe718ea2-e43b-4033-89a6-abfb61b66289 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:15.170989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fe718ea2-e43b-4033-89a6-abfb61b66289 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:15.178868 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fe718ea2-e43b-4033-89a6-abfb61b66289 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:15.179308 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fe718ea2-e43b-4033-89a6-abfb61b66289 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:15.180086 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fe718ea2-e43b-4033-89a6-abfb61b66289 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:15.180521 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fe718ea2-e43b-4033-89a6-abfb61b66289 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:15.300422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8439b88b-1532-4b67-9d7b-646299d53e4f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:15.301045 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8439b88b-1532-4b67-9d7b-646299d53e4f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:15.309841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8439b88b-1532-4b67-9d7b-646299d53e4f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:15.310303 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8439b88b-1532-4b67-9d7b-646299d53e4f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:15.311111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8439b88b-1532-4b67-9d7b-646299d53e4f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:15.311555 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8439b88b-1532-4b67-9d7b-646299d53e4f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:15.335588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fe718ea2-e43b-4033-89a6-abfb61b66289 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:15.356152 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fe718ea2-e43b-4033-89a6-abfb61b66289 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.189207 May 18 17:12:15.357210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 314/614] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:15 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:15.469364 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8439b88b-1532-4b67-9d7b-646299d53e4f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:15.478316 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8439b88b-1532-4b67-9d7b-646299d53e4f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1677 microversion: 2.1 time: 0.181949 May 18 17:12:15.478945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 301/615] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:15 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1677 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:16.380195 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9b5125a8-6703-441f-ac6d-87b70c7da094 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:16.380801 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9b5125a8-6703-441f-ac6d-87b70c7da094 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:16.388594 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9b5125a8-6703-441f-ac6d-87b70c7da094 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:16.389034 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9b5125a8-6703-441f-ac6d-87b70c7da094 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:16.389826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9b5125a8-6703-441f-ac6d-87b70c7da094 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:16.390277 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9b5125a8-6703-441f-ac6d-87b70c7da094 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:16.497545 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0397150c-ff0f-4817-a347-76ee511005e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:16.499174 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0397150c-ff0f-4817-a347-76ee511005e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:16.508677 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0397150c-ff0f-4817-a347-76ee511005e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:16.509517 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0397150c-ff0f-4817-a347-76ee511005e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:16.510657 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0397150c-ff0f-4817-a347-76ee511005e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:16.511331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0397150c-ff0f-4817-a347-76ee511005e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:16.540123 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9b5125a8-6703-441f-ac6d-87b70c7da094 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:16.550725 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9b5125a8-6703-441f-ac6d-87b70c7da094 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.174350 May 18 17:12:16.551692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 315/616] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:16 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:16.677454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0397150c-ff0f-4817-a347-76ee511005e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:16.690425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0397150c-ff0f-4817-a347-76ee511005e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1654 microversion: 2.1 time: 0.197827 May 18 17:12:16.691012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 302/617] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:16 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1654 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:16.708275 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-701f471d-f7d9-409f-b0a3-00b6bcc299ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:16.715474 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-701f471d-f7d9-409f-b0a3-00b6bcc299ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:16.716181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-701f471d-f7d9-409f-b0a3-00b6bcc299ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:16.742532 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-701f471d-f7d9-409f-b0a3-00b6bcc299ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Going to try to start instance {{(pid=117731) start /opt/stack/nova/nova/compute/api.py:2730}} May 18 17:12:16.787836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-701f471d-f7d9-409f-b0a3-00b6bcc299ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/action" status: 202 len: 0 microversion: 2.1 time: 0.082801 May 18 17:12:16.788925 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 316/618] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:12:16 2022] POST /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 17:12:16.797685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-64157616-adaf-4b0f-9b9d-952736cf485f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:16.798392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-64157616-adaf-4b0f-9b9d-952736cf485f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:16.806200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-64157616-adaf-4b0f-9b9d-952736cf485f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:16.806667 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-64157616-adaf-4b0f-9b9d-952736cf485f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:16.807456 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-64157616-adaf-4b0f-9b9d-952736cf485f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:16.807897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-64157616-adaf-4b0f-9b9d-952736cf485f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:16.956202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-64157616-adaf-4b0f-9b9d-952736cf485f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:16.965989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-64157616-adaf-4b0f-9b9d-952736cf485f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1663 microversion: 2.1 time: 0.172263 May 18 17:12:16.966577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 303/619] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:16 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1663 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:17.571832 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-14b1bd5e-00a8-446f-99c5-af79c1a49cae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:17.572553 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-14b1bd5e-00a8-446f-99c5-af79c1a49cae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:17.579012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14b1bd5e-00a8-446f-99c5-af79c1a49cae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:17.579627 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14b1bd5e-00a8-446f-99c5-af79c1a49cae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:17.580414 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14b1bd5e-00a8-446f-99c5-af79c1a49cae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:17.580857 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14b1bd5e-00a8-446f-99c5-af79c1a49cae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:17.731255 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-14b1bd5e-00a8-446f-99c5-af79c1a49cae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:17.740816 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-14b1bd5e-00a8-446f-99c5-af79c1a49cae tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.174091 May 18 17:12:17.741336 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 317/620] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:17 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:17.985266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-48397cd4-d314-4e51-b069-204bb725af08 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:17.985964 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-48397cd4-d314-4e51-b069-204bb725af08 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:17.994341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48397cd4-d314-4e51-b069-204bb725af08 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:17.994709 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48397cd4-d314-4e51-b069-204bb725af08 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:17.995504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48397cd4-d314-4e51-b069-204bb725af08 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:17.995946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-48397cd4-d314-4e51-b069-204bb725af08 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:18.146754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-48397cd4-d314-4e51-b069-204bb725af08 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:18.156467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-48397cd4-d314-4e51-b069-204bb725af08 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1663 microversion: 2.1 time: 0.175946 May 18 17:12:18.157052 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 304/621] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:17 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1663 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:18.758519 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dfe43e90-750f-4293-9b9f-fe3492e48066 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:18.759221 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dfe43e90-750f-4293-9b9f-fe3492e48066 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:18.766439 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfe43e90-750f-4293-9b9f-fe3492e48066 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:18.766891 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfe43e90-750f-4293-9b9f-fe3492e48066 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:18.767663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfe43e90-750f-4293-9b9f-fe3492e48066 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:18.768094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfe43e90-750f-4293-9b9f-fe3492e48066 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:18.910636 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dfe43e90-750f-4293-9b9f-fe3492e48066 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:18.920046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dfe43e90-750f-4293-9b9f-fe3492e48066 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.166137 May 18 17:12:18.920616 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 318/622] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:18 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:19.176141 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-34fcbbf4-7783-4251-a825-bcebf98c67f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:19.176757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-34fcbbf4-7783-4251-a825-bcebf98c67f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:19.183645 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34fcbbf4-7783-4251-a825-bcebf98c67f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:19.184093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34fcbbf4-7783-4251-a825-bcebf98c67f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:19.184858 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34fcbbf4-7783-4251-a825-bcebf98c67f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:19.185291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-34fcbbf4-7783-4251-a825-bcebf98c67f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:19.321048 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-34fcbbf4-7783-4251-a825-bcebf98c67f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:19.328580 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-34fcbbf4-7783-4251-a825-bcebf98c67f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1667 microversion: 2.1 time: 0.156333 May 18 17:12:19.329146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 305/623] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:19 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1667 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:19.936375 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-94bfeb8c-a364-47bc-a775-4795e69e4d7f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:19.937034 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-94bfeb8c-a364-47bc-a775-4795e69e4d7f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:19.944215 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-94bfeb8c-a364-47bc-a775-4795e69e4d7f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:19.944673 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-94bfeb8c-a364-47bc-a775-4795e69e4d7f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:19.945447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-94bfeb8c-a364-47bc-a775-4795e69e4d7f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:19.945919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-94bfeb8c-a364-47bc-a775-4795e69e4d7f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:19.961477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:20.099171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-94bfeb8c-a364-47bc-a775-4795e69e4d7f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:20.108066 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-94bfeb8c-a364-47bc-a775-4795e69e4d7f tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.175508 May 18 17:12:20.108636 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 319/624] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:19 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:21.125622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e2a7766e-56c7-432d-ac12-ec45fff66fc2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:21.126260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e2a7766e-56c7-432d-ac12-ec45fff66fc2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:21.133599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e2a7766e-56c7-432d-ac12-ec45fff66fc2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:21.134075 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e2a7766e-56c7-432d-ac12-ec45fff66fc2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:21.134841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e2a7766e-56c7-432d-ac12-ec45fff66fc2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:21.135276 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e2a7766e-56c7-432d-ac12-ec45fff66fc2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:21.267744 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e2a7766e-56c7-432d-ac12-ec45fff66fc2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:21.275886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e2a7766e-56c7-432d-ac12-ec45fff66fc2 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.154113 May 18 17:12:21.276467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 306/625] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:21 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:22.292668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-89924410-fdee-45d4-a3e0-b8ad5d4cdf01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:22.293316 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-89924410-fdee-45d4-a3e0-b8ad5d4cdf01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:22.299973 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-89924410-fdee-45d4-a3e0-b8ad5d4cdf01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:22.300419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-89924410-fdee-45d4-a3e0-b8ad5d4cdf01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:22.301174 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-89924410-fdee-45d4-a3e0-b8ad5d4cdf01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:22.301605 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-89924410-fdee-45d4-a3e0-b8ad5d4cdf01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:22.445348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-89924410-fdee-45d4-a3e0-b8ad5d4cdf01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:22.453218 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-89924410-fdee-45d4-a3e0-b8ad5d4cdf01 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.164331 May 18 17:12:22.453823 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 320/626] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:22 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:23.471349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-778815df-ebd0-46e7-bf70-82e0654287c9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:23.471988 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-778815df-ebd0-46e7-bf70-82e0654287c9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:23.479453 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-778815df-ebd0-46e7-bf70-82e0654287c9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:23.479907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-778815df-ebd0-46e7-bf70-82e0654287c9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:23.480714 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-778815df-ebd0-46e7-bf70-82e0654287c9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:23.481149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-778815df-ebd0-46e7-bf70-82e0654287c9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:23.486385 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:23.633541 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-778815df-ebd0-46e7-bf70-82e0654287c9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:23.641371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-778815df-ebd0-46e7-bf70-82e0654287c9 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.173971 May 18 17:12:23.641990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 307/627] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:23 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:24.659764 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b785399d-8220-4e4e-bf3d-1cbb5b352d37 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:24.660374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b785399d-8220-4e4e-bf3d-1cbb5b352d37 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:24.668702 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b785399d-8220-4e4e-bf3d-1cbb5b352d37 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:24.669224 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b785399d-8220-4e4e-bf3d-1cbb5b352d37 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:24.670051 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b785399d-8220-4e4e-bf3d-1cbb5b352d37 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:24.670576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b785399d-8220-4e4e-bf3d-1cbb5b352d37 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:24.812017 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b785399d-8220-4e4e-bf3d-1cbb5b352d37 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:24.820582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b785399d-8220-4e4e-bf3d-1cbb5b352d37 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.164779 May 18 17:12:24.821131 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 321/628] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:24 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:25.131275 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-d3ea7698-9bdb-4c14-b218-33b84a5686bc req-a3254c7d-20f2-4b32-a09f-daa7821fa697 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee", "name": "network-vif-plugged", "status": "completed", "tag": "cac676f2-4e76-4013-9947-99f06f080ac2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:25.140990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d3ea7698-9bdb-4c14-b218-33b84a5686bc req-a3254c7d-20f2-4b32-a09f-daa7821fa697 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:25.141561 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-d3ea7698-9bdb-4c14-b218-33b84a5686bc req-a3254c7d-20f2-4b32-a09f-daa7821fa697 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:25.155804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-d3ea7698-9bdb-4c14-b218-33b84a5686bc req-a3254c7d-20f2-4b32-a09f-daa7821fa697 service nova] Creating event network-vif-plugged:cac676f2-4e76-4013-9947-99f06f080ac2 for instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee on hv-cinder-79578 May 18 17:12:25.161735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-d3ea7698-9bdb-4c14-b218-33b84a5686bc req-a3254c7d-20f2-4b32-a09f-daa7821fa697 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034695 May 18 17:12:25.162618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 308/629] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:12:25.838234 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0352e9e4-5c60-412b-bbfe-156b4b117878 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:25.838882 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0352e9e4-5c60-412b-bbfe-156b4b117878 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:25.846145 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0352e9e4-5c60-412b-bbfe-156b4b117878 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:25.846592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0352e9e4-5c60-412b-bbfe-156b4b117878 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:25.847352 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0352e9e4-5c60-412b-bbfe-156b4b117878 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:25.847781 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0352e9e4-5c60-412b-bbfe-156b4b117878 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:25.987973 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0352e9e4-5c60-412b-bbfe-156b4b117878 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:25.996348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0352e9e4-5c60-412b-bbfe-156b4b117878 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.162099 May 18 17:12:25.996924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 322/630] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:25 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:27.013460 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cb69fb72-ed6b-481f-b841-5d705d7e8143 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:27.014206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cb69fb72-ed6b-481f-b841-5d705d7e8143 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:27.020816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb69fb72-ed6b-481f-b841-5d705d7e8143 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:27.021292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb69fb72-ed6b-481f-b841-5d705d7e8143 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:27.022277 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb69fb72-ed6b-481f-b841-5d705d7e8143 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:27.022720 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb69fb72-ed6b-481f-b841-5d705d7e8143 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:27.163561 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cb69fb72-ed6b-481f-b841-5d705d7e8143 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:27.171469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cb69fb72-ed6b-481f-b841-5d705d7e8143 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1574 microversion: 2.1 time: 0.162295 May 18 17:12:27.172047 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 309/631] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:27 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:28.188889 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ab0b511b-0e55-4225-a178-b14bce0cc71c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:28.189650 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ab0b511b-0e55-4225-a178-b14bce0cc71c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:28.197354 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab0b511b-0e55-4225-a178-b14bce0cc71c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:28.197858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab0b511b-0e55-4225-a178-b14bce0cc71c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:28.198634 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab0b511b-0e55-4225-a178-b14bce0cc71c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:28.199073 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab0b511b-0e55-4225-a178-b14bce0cc71c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:28.330792 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ab0b511b-0e55-4225-a178-b14bce0cc71c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:28.338539 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ab0b511b-0e55-4225-a178-b14bce0cc71c tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1561 microversion: 2.1 time: 0.153612 May 18 17:12:28.339104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 323/632] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:28 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:34.314740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6c6f1abb-f8ce-47cb-a79f-c561f8564394 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:34.315255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6c6f1abb-f8ce-47cb-a79f-c561f8564394 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:34.322110 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c6f1abb-f8ce-47cb-a79f-c561f8564394 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:34.322486 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c6f1abb-f8ce-47cb-a79f-c561f8564394 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:34.323255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c6f1abb-f8ce-47cb-a79f-c561f8564394 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:34.323692 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c6f1abb-f8ce-47cb-a79f-c561f8564394 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:34.346972 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6c6f1abb-f8ce-47cb-a79f-c561f8564394 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a/ips" status: 200 len: 148 microversion: 2.1 time: 0.096678 May 18 17:12:34.347613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 310/633] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:12:34 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a/ips => generated 148 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:12:34.358674 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d95d4492-5ae5-4d7a-8721-eff478ae0742"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:34.359822 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:34.361947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=54 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:34.368070 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:34.368516 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:34.369295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:34.369769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:34.454398 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Invalid volume: volume d95d4492-5ae5-4d7a-8721-eff478ae0742 is already attached to instances: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: POST /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a/os-volume_attachments HTTP/1.1 May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 74 May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:12:34.456140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {"volumeAttachment": {"volumeId": "d95d4492-5ae5-4d7a-8721-eff478ae0742"}} May 18 17:12:34.457938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Invalid volume: volume d95d4492-5ae5-4d7a-8721-eff478ae0742 is already attached to instances: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'server_id': 'fe8e9b40-b673-4589-8cc1-578d155c9f9a', 'body': {'volumeAttachment': {'volumeId': 'd95d4492-5ae5-4d7a-8721-eff478ae0742'}}} May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d95d4492-5ae5-4d7a-8721-eff478ae0742 is already attached to instances: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:34.458858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d95d4492-5ae5-4d7a-8721-eff478ae0742 is already attached to instances: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:34.459996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:12:34.461315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:12:34.461315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:12:34.461315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:12:34.461315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d95d4492-5ae5-4d7a-8721-eff478ae0742 is already attached to instances: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e May 18 17:12:34.461315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:34.461315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 400 to user: Invalid volume: volume d95d4492-5ae5-4d7a-8721-eff478ae0742 is already attached to instances: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:12:34.461315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-63174a25-d5f0-4e97-8949-36a15e1f5505 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103109 May 18 17:12:34.461315 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 324/634] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:12:34 2022] POST /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 17:12:34.467715 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3a58bea5-6f31-4e3b-bfbe-09257e65d2df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:34.468225 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3a58bea5-6f31-4e3b-bfbe-09257e65d2df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:34.475130 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3a58bea5-6f31-4e3b-bfbe-09257e65d2df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:34.475577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3a58bea5-6f31-4e3b-bfbe-09257e65d2df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:34.476368 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3a58bea5-6f31-4e3b-bfbe-09257e65d2df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:34.476810 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3a58bea5-6f31-4e3b-bfbe-09257e65d2df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:34.503724 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3a58bea5-6f31-4e3b-bfbe-09257e65d2df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:12:34.585693 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3a58bea5-6f31-4e3b-bfbe-09257e65d2df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 204 len: 0 microversion: 2.1 time: 0.122094 May 18 17:12:34.586970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 311/635] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:12:34 2022] DELETE /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 17:12:34.596747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bed02968-9ba2-4420-8d5f-e7fbcec3298a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:34.597358 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bed02968-9ba2-4420-8d5f-e7fbcec3298a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:34.604243 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bed02968-9ba2-4420-8d5f-e7fbcec3298a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:34.604685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bed02968-9ba2-4420-8d5f-e7fbcec3298a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:34.605446 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bed02968-9ba2-4420-8d5f-e7fbcec3298a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:34.605917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bed02968-9ba2-4420-8d5f-e7fbcec3298a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:34.747937 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bed02968-9ba2-4420-8d5f-e7fbcec3298a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:34.755817 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bed02968-9ba2-4420-8d5f-e7fbcec3298a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1680 microversion: 2.1 time: 0.163476 May 18 17:12:34.756358 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 325/636] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:34 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:35.774075 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c311377b-c0b0-40c5-a6db-768b495cdfa9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:35.774780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c311377b-c0b0-40c5-a6db-768b495cdfa9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:35.781418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c311377b-c0b0-40c5-a6db-768b495cdfa9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:35.781923 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c311377b-c0b0-40c5-a6db-768b495cdfa9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:35.782708 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c311377b-c0b0-40c5-a6db-768b495cdfa9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:35.783150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c311377b-c0b0-40c5-a6db-768b495cdfa9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:35.937749 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c311377b-c0b0-40c5-a6db-768b495cdfa9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:35.947580 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c311377b-c0b0-40c5-a6db-768b495cdfa9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1680 microversion: 2.1 time: 0.178340 May 18 17:12:35.948379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 312/637] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:35 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:12:36.972622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dfcbd178-6c9e-4072-8059-85f66ac644ca tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:36.973233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dfcbd178-6c9e-4072-8059-85f66ac644ca tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:36.980408 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfcbd178-6c9e-4072-8059-85f66ac644ca tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:36.980860 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfcbd178-6c9e-4072-8059-85f66ac644ca tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:36.981633 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfcbd178-6c9e-4072-8059-85f66ac644ca tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:36.982088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dfcbd178-6c9e-4072-8059-85f66ac644ca tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:37.281876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dfcbd178-6c9e-4072-8059-85f66ac644ca tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:37.292277 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dfcbd178-6c9e-4072-8059-85f66ac644ca tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1680 microversion: 2.1 time: 0.323040 May 18 17:12:37.293143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 326/638] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:36 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1680 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:37.945827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-43e4390d-36bc-41e9-a459-bec7a448179a req-1891b2fa-b39d-49a9-ac66-0942da053e65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8e9b40-b673-4589-8cc1-578d155c9f9a", "name": "network-vif-deleted", "tag": "614f9000-57d7-40d6-bb66-cd4695782044"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:37.970034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-43e4390d-36bc-41e9-a459-bec7a448179a req-1891b2fa-b39d-49a9-ac66-0942da053e65 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:37.971206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-43e4390d-36bc-41e9-a459-bec7a448179a req-1891b2fa-b39d-49a9-ac66-0942da053e65 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:37.986951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-43e4390d-36bc-41e9-a459-bec7a448179a req-1891b2fa-b39d-49a9-ac66-0942da053e65 service nova] Creating event network-vif-deleted:614f9000-57d7-40d6-bb66-cd4695782044 for instance fe8e9b40-b673-4589-8cc1-578d155c9f9a on hv-cinder-79578 May 18 17:12:37.992577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-43e4390d-36bc-41e9-a459-bec7a448179a req-1891b2fa-b39d-49a9-ac66-0942da053e65 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161122 May 18 17:12:37.993214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 313/639] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:12:38.316145 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:38.316753 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:38.324554 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:38.325087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:38.325892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:38.326338 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:38.368481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:38.369048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:38.369548 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lazy-loading 'fault' on Instance uuid fe8e9b40-b673-4589-8cc1-578d155c9f9a {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:12:38.424092 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:38.432147 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-10168963-7962-4150-b2bb-14d468e05bd0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 200 len: 1332 microversion: 2.1 time: 0.119869 May 18 17:12:38.433111 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 327/640] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:38 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:39.450012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:39.450830 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:39.457455 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:39.457919 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:39.459347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:39.459796 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:39.476263 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a HTTP/1.1 May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:12:39.477926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:12:39.479506 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'fe8e9b40-b673-4589-8cc1-578d155c9f9a'} May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:12:39.480296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:12:39.481842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:12:39.483318 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:12:39.483318 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d4735233-8228-4198-8ee8-dd8442638f53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 404 len: 111 microversion: 2.1 time: 0.034181 May 18 17:12:39.483318 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 314/641] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:39 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 17:12:39.491125 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-189da877-f2a1-4285-916e-4699b1c7dd57 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '.version_select at 0x7feef3ceae50>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:39.517222 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-189da877-f2a1-4285-916e-4699b1c7dd57 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058820505" status: 202 len: 0 microversion: 2.1 time: 0.032182 May 18 17:12:39.518219 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 328/642] 10.222.0.49 () {58 vars in 1220 bytes} [Wed May 18 17:12:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2058820505 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 17:12:40.289564 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0bbcd3e1-e784-4b93-99c5-b431da623097 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:40.290090 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0bbcd3e1-e784-4b93-99c5-b431da623097 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:40.296841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bbcd3e1-e784-4b93-99c5-b431da623097 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:40.297578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bbcd3e1-e784-4b93-99c5-b431da623097 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:40.298091 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bbcd3e1-e784-4b93-99c5-b431da623097 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:40.298532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bbcd3e1-e784-4b93-99c5-b431da623097 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:40.398339 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-0bbcd3e1-e784-4b93-99c5-b431da623097 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lazy-loading 'services' on Instance uuid 76ee8046-a947-4f1c-badc-cdf4a50fcd6e {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:12:40.486316 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0bbcd3e1-e784-4b93-99c5-b431da623097 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments/d95d4492-5ae5-4d7a-8721-eff478ae0742" status: 202 len: 0 microversion: 2.1 time: 0.200829 May 18 17:12:40.490408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 315/643] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:12:40 2022] DELETE /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments/d95d4492-5ae5-4d7a-8721-eff478ae0742 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:12:40.495973 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-451dfba3-6c19-47b7-807d-c0d6854552b9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:40.497690 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-451dfba3-6c19-47b7-807d-c0d6854552b9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:40.507378 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-451dfba3-6c19-47b7-807d-c0d6854552b9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:40.507999 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-451dfba3-6c19-47b7-807d-c0d6854552b9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:40.509153 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-451dfba3-6c19-47b7-807d-c0d6854552b9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:40.510471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-451dfba3-6c19-47b7-807d-c0d6854552b9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:40.544904 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-451dfba3-6c19-47b7-807d-c0d6854552b9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053356 May 18 17:12:40.546038 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 329/644] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:12:40 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:12:41.558830 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ecf776a9-d2cc-43d1-afe5-9ba81740d071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:41.559888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ecf776a9-d2cc-43d1-afe5-9ba81740d071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:41.566723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecf776a9-d2cc-43d1-afe5-9ba81740d071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:41.567167 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecf776a9-d2cc-43d1-afe5-9ba81740d071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:41.568213 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecf776a9-d2cc-43d1-afe5-9ba81740d071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:41.568561 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecf776a9-d2cc-43d1-afe5-9ba81740d071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:41.604160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ecf776a9-d2cc-43d1-afe5-9ba81740d071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049732 May 18 17:12:41.604748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 316/645] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:12:41 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:12:42.616569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-04620ba5-2605-4bca-b263-30558f0d687d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:42.617504 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-04620ba5-2605-4bca-b263-30558f0d687d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:42.624307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04620ba5-2605-4bca-b263-30558f0d687d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:42.624757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04620ba5-2605-4bca-b263-30558f0d687d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:42.625532 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04620ba5-2605-4bca-b263-30558f0d687d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:42.626003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04620ba5-2605-4bca-b263-30558f0d687d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:42.656575 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-04620ba5-2605-4bca-b263-30558f0d687d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044434 May 18 17:12:42.657154 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 330/646] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:12:42 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 18 17:12:42.718006 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-10096c6c-98ed-40b7-92ac-b7eef58aa65b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:42.718550 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-10096c6c-98ed-40b7-92ac-b7eef58aa65b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:42.726617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10096c6c-98ed-40b7-92ac-b7eef58aa65b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:42.727067 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10096c6c-98ed-40b7-92ac-b7eef58aa65b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:42.727846 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10096c6c-98ed-40b7-92ac-b7eef58aa65b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:42.728278 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-10096c6c-98ed-40b7-92ac-b7eef58aa65b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:42.754592 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-10096c6c-98ed-40b7-92ac-b7eef58aa65b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:12:42.846092 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-10096c6c-98ed-40b7-92ac-b7eef58aa65b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 204 len: 0 microversion: 2.1 time: 0.131583 May 18 17:12:42.846708 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 317/647] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:12:42 2022] DELETE /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 17:12:42.856366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0d83ca79-1cac-4d7e-bb55-e845cac2174a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:42.857009 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0d83ca79-1cac-4d7e-bb55-e845cac2174a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:42.863269 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d83ca79-1cac-4d7e-bb55-e845cac2174a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:42.863735 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d83ca79-1cac-4d7e-bb55-e845cac2174a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:42.865102 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d83ca79-1cac-4d7e-bb55-e845cac2174a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:42.865620 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0d83ca79-1cac-4d7e-bb55-e845cac2174a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:43.000618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0d83ca79-1cac-4d7e-bb55-e845cac2174a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:43.009150 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0d83ca79-1cac-4d7e-bb55-e845cac2174a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1680 microversion: 2.1 time: 0.156831 May 18 17:12:43.009746 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 331/648] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:42 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:44.029401 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bcda224d-86eb-4ce7-9dce-b7a2c60b00ba tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:44.030168 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bcda224d-86eb-4ce7-9dce-b7a2c60b00ba tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:44.032584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:44.039148 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcda224d-86eb-4ce7-9dce-b7a2c60b00ba tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:44.039592 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcda224d-86eb-4ce7-9dce-b7a2c60b00ba tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:44.040369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcda224d-86eb-4ce7-9dce-b7a2c60b00ba tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:44.040801 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcda224d-86eb-4ce7-9dce-b7a2c60b00ba tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:44.179100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bcda224d-86eb-4ce7-9dce-b7a2c60b00ba tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:44.186765 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bcda224d-86eb-4ce7-9dce-b7a2c60b00ba tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1680 microversion: 2.1 time: 0.162639 May 18 17:12:44.187359 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 318/649] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:44 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:45.204430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-01ca2d08-f025-4e05-8ac4-8432c4870848 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:45.205208 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-01ca2d08-f025-4e05-8ac4-8432c4870848 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:45.212232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-01ca2d08-f025-4e05-8ac4-8432c4870848 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:45.212695 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-01ca2d08-f025-4e05-8ac4-8432c4870848 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:45.213476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-01ca2d08-f025-4e05-8ac4-8432c4870848 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:45.213945 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-01ca2d08-f025-4e05-8ac4-8432c4870848 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:45.288081 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-01ca2d08-f025-4e05-8ac4-8432c4870848 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:45.296087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-01ca2d08-f025-4e05-8ac4-8432c4870848 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 200 len: 1612 microversion: 2.1 time: 0.095428 May 18 17:12:45.296884 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 332/650] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:45 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 1612 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:45.342892 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-1bfa55d6-168e-4e9d-9169-23e72b118709 req-f96357c2-55de-45f4-b8a4-3a0521f807c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76ee8046-a947-4f1c-badc-cdf4a50fcd6e", "name": "network-vif-deleted", "tag": "68dda7a1-bf2e-4af2-b271-828eec9d063b"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:45.352571 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1bfa55d6-168e-4e9d-9169-23e72b118709 req-f96357c2-55de-45f4-b8a4-3a0521f807c6 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:45.353007 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1bfa55d6-168e-4e9d-9169-23e72b118709 req-f96357c2-55de-45f4-b8a4-3a0521f807c6 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:45.365636 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-1bfa55d6-168e-4e9d-9169-23e72b118709 req-f96357c2-55de-45f4-b8a4-3a0521f807c6 service nova] Creating event network-vif-deleted:68dda7a1-bf2e-4af2-b271-828eec9d063b for instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e on hv-cinder-79578 May 18 17:12:45.370754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-1bfa55d6-168e-4e9d-9169-23e72b118709 req-f96357c2-55de-45f4-b8a4-3a0521f807c6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031644 May 18 17:12:45.375353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 319/651] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:12:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:12:46.314997 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:46.315721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:46.323998 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:46.324452 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:46.325229 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:46.325682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:46.341172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e HTTP/1.1 May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:12:46.342757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:12:46.344246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '76ee8046-a947-4f1c-badc-cdf4a50fcd6e'} May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:12:46.345075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:12:46.346230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:12:46.347374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:12:46.347374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c8f749bf-145e-46c0-b9ad-71c59574881b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 404 len: 111 microversion: 2.1 time: 0.033157 May 18 17:12:46.347374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 333/652] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:46 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:12:46.354581 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0f8db037-d1f3-40b6-93f1-86a64be7c334 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '.version_select at 0x7fef00226040>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:46.374062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0f8db037-d1f3-40b6-93f1-86a64be7c334 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-721053032" status: 202 len: 0 microversion: 2.1 time: 0.024398 May 18 17:12:46.374643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 320/653] 10.222.0.49 () {58 vars in 1217 bytes} [Wed May 18 17:12:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-721053032 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:12:47.004283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5b0d60c6-c480-4b34-90d8-00206c1545e8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: .version_select at 0x7feef3d549d0>, body: {"keypair": {"name": "tempest-keypair-1853147682", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL+wvXLisCOI7vKGXwyMZ9glGdC/iEm90Nyzo+alP1vEk8D/h28WhYaZ7T5BSi5ZdQcifkjrBVSLJj4de0s1d9dT7bw2JE/MWfbMgEBQSHhC5G9MfcX+C62qO9fIWVszyw=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:47.019011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-5b0d60c6-c480-4b34-90d8-00206c1545e8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:12:47.023695 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-5b0d60c6-c480-4b34-90d8-00206c1545e8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for user 01881ccdf756480b8fcc1ac599fdf905 and project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:12:47.048575 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5b0d60c6-c480-4b34-90d8-00206c1545e8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048209 May 18 17:12:47.049182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 334/654] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:12:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:12:48.388251 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1743801064", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1747880-dcf4-4125-af66-c635d137ec57"}], "security_groups": [{"name": "tempest-securitygroup--228670030"}], "key_name": "tempest-keypair-1853147682", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:48.490847 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] validate_networks() for [('f1747880-dcf4-4125-af66-c635d137ec57', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:12:48.938956 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:12:48.939378 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:12:48.939853 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:12:48.940261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:12:48.940674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:12:48.951261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:48.951708 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:48.952507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:48.952944 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:48.971285 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:12:48.976194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for user 01881ccdf756480b8fcc1ac599fdf905 and project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:12:48.987650 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:12:48.990941 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:12:49.042093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0880aa2a-9f37-4bdb-b703-52d568380ae6 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.658495 May 18 17:12:49.042741 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 321/655] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:12:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:12:49.053681 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-158b1341-4896-4187-bc3e-c36327a8ae76 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:49.054521 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-158b1341-4896-4187-bc3e-c36327a8ae76 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:49.116356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-158b1341-4896-4187-bc3e-c36327a8ae76 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:49.123939 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-158b1341-4896-4187-bc3e-c36327a8ae76 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1242 microversion: 2.1 time: 0.074901 May 18 17:12:49.124845 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 335/656] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:49 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:50.140780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-97893625-0377-4665-812e-2d54299f92d8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:50.141391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-97893625-0377-4665-812e-2d54299f92d8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:50.149391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97893625-0377-4665-812e-2d54299f92d8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:50.149875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97893625-0377-4665-812e-2d54299f92d8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:50.150640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97893625-0377-4665-812e-2d54299f92d8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:50.151066 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-97893625-0377-4665-812e-2d54299f92d8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:50.218068 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-97893625-0377-4665-812e-2d54299f92d8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:50.231305 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-97893625-0377-4665-812e-2d54299f92d8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1302 microversion: 2.1 time: 0.094250 May 18 17:12:50.232175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 322/657] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:50 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1302 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:51.250088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-50549d42-eda4-45bc-a000-2b219088ff00 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:51.250722 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-50549d42-eda4-45bc-a000-2b219088ff00 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:51.258804 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-50549d42-eda4-45bc-a000-2b219088ff00 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:51.259262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-50549d42-eda4-45bc-a000-2b219088ff00 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:51.260056 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-50549d42-eda4-45bc-a000-2b219088ff00 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:51.260498 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-50549d42-eda4-45bc-a000-2b219088ff00 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:51.264936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=80 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:51.507747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-50549d42-eda4-45bc-a000-2b219088ff00 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:51.516508 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-50549d42-eda4-45bc-a000-2b219088ff00 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.270363 May 18 17:12:51.517754 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 336/658] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:51 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:51.928242 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-b874e064-6a76-470b-aa52-8cf3b327c4db req-46c53213-ddc7-47b2-b93f-2705ef355252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc5c540-cca9-45b1-8f26-a3a7e20726fc", "tag": "b64cd2ca-bae4-4611-99a1-1520fac5e7f4"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:51.938488 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b874e064-6a76-470b-aa52-8cf3b327c4db req-46c53213-ddc7-47b2-b93f-2705ef355252 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:51.939269 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b874e064-6a76-470b-aa52-8cf3b327c4db req-46c53213-ddc7-47b2-b93f-2705ef355252 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:51.959293 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-b874e064-6a76-470b-aa52-8cf3b327c4db req-46c53213-ddc7-47b2-b93f-2705ef355252 service nova] Creating event network-changed:b64cd2ca-bae4-4611-99a1-1520fac5e7f4 for instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc on hv-cinder-79578 May 18 17:12:51.964978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-b874e064-6a76-470b-aa52-8cf3b327c4db req-46c53213-ddc7-47b2-b93f-2705ef355252 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042300 May 18 17:12:51.966039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 323/659] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:12:52.535190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5ec8522e-3a7b-4cd3-ac62-c173a7a71bf9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:52.535834 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5ec8522e-3a7b-4cd3-ac62-c173a7a71bf9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:52.542961 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ec8522e-3a7b-4cd3-ac62-c173a7a71bf9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:52.543415 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ec8522e-3a7b-4cd3-ac62-c173a7a71bf9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:52.544184 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ec8522e-3a7b-4cd3-ac62-c173a7a71bf9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:52.544617 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5ec8522e-3a7b-4cd3-ac62-c173a7a71bf9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:52.683290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5ec8522e-3a7b-4cd3-ac62-c173a7a71bf9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:52.691529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5ec8522e-3a7b-4cd3-ac62-c173a7a71bf9 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.160143 May 18 17:12:52.692114 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 337/660] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:52 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:53.710605 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-06a9096d-2065-44c3-8b0c-618e3c20f33a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:53.711490 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-06a9096d-2065-44c3-8b0c-618e3c20f33a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:53.718451 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06a9096d-2065-44c3-8b0c-618e3c20f33a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:53.718897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06a9096d-2065-44c3-8b0c-618e3c20f33a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:53.719656 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06a9096d-2065-44c3-8b0c-618e3c20f33a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:53.720089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-06a9096d-2065-44c3-8b0c-618e3c20f33a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:53.724032 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:53.852050 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-06a9096d-2065-44c3-8b0c-618e3c20f33a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:53.859352 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-06a9096d-2065-44c3-8b0c-618e3c20f33a tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.154577 May 18 17:12:53.859917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 324/661] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:53 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:54.876524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-74cc146c-0f84-41b6-a221-17f0332c9b67 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:54.877150 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-74cc146c-0f84-41b6-a221-17f0332c9b67 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:54.884089 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74cc146c-0f84-41b6-a221-17f0332c9b67 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:54.884576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74cc146c-0f84-41b6-a221-17f0332c9b67 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:54.885364 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74cc146c-0f84-41b6-a221-17f0332c9b67 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:54.885842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-74cc146c-0f84-41b6-a221-17f0332c9b67 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:55.019150 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-74cc146c-0f84-41b6-a221-17f0332c9b67 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:55.027238 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-74cc146c-0f84-41b6-a221-17f0332c9b67 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.154624 May 18 17:12:55.027855 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 338/662] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:54 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:56.044732 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1390af7c-d3de-411a-9683-fa486b116946 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:56.045434 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1390af7c-d3de-411a-9683-fa486b116946 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:56.052100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1390af7c-d3de-411a-9683-fa486b116946 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:56.052538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1390af7c-d3de-411a-9683-fa486b116946 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:56.053369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1390af7c-d3de-411a-9683-fa486b116946 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:56.053750 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1390af7c-d3de-411a-9683-fa486b116946 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:56.199621 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1390af7c-d3de-411a-9683-fa486b116946 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:56.207428 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1390af7c-d3de-411a-9683-fa486b116946 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.166600 May 18 17:12:56.208075 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 325/663] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:56 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:57.225935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-48d73291-8757-4fa4-8ce6-56b5771a40a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:57.226621 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-48d73291-8757-4fa4-8ce6-56b5771a40a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:57.234728 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48d73291-8757-4fa4-8ce6-56b5771a40a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:57.235246 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48d73291-8757-4fa4-8ce6-56b5771a40a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:57.236164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48d73291-8757-4fa4-8ce6-56b5771a40a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:57.236662 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-48d73291-8757-4fa4-8ce6-56b5771a40a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:57.383820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-48d73291-8757-4fa4-8ce6-56b5771a40a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:57.392835 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-48d73291-8757-4fa4-8ce6-56b5771a40a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.171557 May 18 17:12:57.393595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 339/664] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:57 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:58.410929 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f7ff779e-179d-49f5-93f5-ca0262ee9d99 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:58.412040 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f7ff779e-179d-49f5-93f5-ca0262ee9d99 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:58.418185 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7ff779e-179d-49f5-93f5-ca0262ee9d99 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:58.418636 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7ff779e-179d-49f5-93f5-ca0262ee9d99 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:58.419433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7ff779e-179d-49f5-93f5-ca0262ee9d99 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:58.419874 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7ff779e-179d-49f5-93f5-ca0262ee9d99 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:58.554227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f7ff779e-179d-49f5-93f5-ca0262ee9d99 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:58.561735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f7ff779e-179d-49f5-93f5-ca0262ee9d99 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.154921 May 18 17:12:58.562311 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 326/665] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:58 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:12:59.326430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-01c44dad-9cff-4d9c-9872-3b0425e38ba4 req-c3fce1df-6128-49f5-8da8-29a72f673a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc5c540-cca9-45b1-8f26-a3a7e20726fc", "name": "network-vif-plugged", "status": "completed", "tag": "b64cd2ca-bae4-4611-99a1-1520fac5e7f4"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:12:59.329938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:59.339207 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-01c44dad-9cff-4d9c-9872-3b0425e38ba4 req-c3fce1df-6128-49f5-8da8-29a72f673a0f service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:59.339667 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-01c44dad-9cff-4d9c-9872-3b0425e38ba4 req-c3fce1df-6128-49f5-8da8-29a72f673a0f service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:59.352416 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-01c44dad-9cff-4d9c-9872-3b0425e38ba4 req-c3fce1df-6128-49f5-8da8-29a72f673a0f service nova] Creating event network-vif-plugged:b64cd2ca-bae4-4611-99a1-1520fac5e7f4 for instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc on hv-cinder-79578 May 18 17:12:59.357430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-01c44dad-9cff-4d9c-9872-3b0425e38ba4 req-c3fce1df-6128-49f5-8da8-29a72f673a0f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035552 May 18 17:12:59.358239 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 340/666] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:12:59.579932 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9e86a4c8-ed17-4dfa-bd9b-0e1cbe0928cd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:12:59.580546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9e86a4c8-ed17-4dfa-bd9b-0e1cbe0928cd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:12:59.582554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:59.584603 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:12:59.591307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9e86a4c8-ed17-4dfa-bd9b-0e1cbe0928cd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:59.591838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9e86a4c8-ed17-4dfa-bd9b-0e1cbe0928cd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:59.592618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9e86a4c8-ed17-4dfa-bd9b-0e1cbe0928cd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:12:59.593047 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9e86a4c8-ed17-4dfa-bd9b-0e1cbe0928cd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:12:59.733520 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9e86a4c8-ed17-4dfa-bd9b-0e1cbe0928cd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:12:59.741258 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9e86a4c8-ed17-4dfa-bd9b-0e1cbe0928cd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.165239 May 18 17:12:59.741876 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 327/667] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:12:59 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:00.758881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0bd322b7-3f73-46c7-b499-6295b1c59501 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:00.759702 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0bd322b7-3f73-46c7-b499-6295b1c59501 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:00.766326 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0bd322b7-3f73-46c7-b499-6295b1c59501 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:00.766769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0bd322b7-3f73-46c7-b499-6295b1c59501 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:00.767524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0bd322b7-3f73-46c7-b499-6295b1c59501 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:00.768101 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0bd322b7-3f73-46c7-b499-6295b1c59501 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:00.902190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0bd322b7-3f73-46c7-b499-6295b1c59501 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:00.909750 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0bd322b7-3f73-46c7-b499-6295b1c59501 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1367 microversion: 2.1 time: 0.155241 May 18 17:13:00.910329 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 341/668] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:00 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:01.927430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ce1b641c-eff8-4aba-98db-edd8fbae49bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:01.928033 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ce1b641c-eff8-4aba-98db-edd8fbae49bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:01.935329 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ce1b641c-eff8-4aba-98db-edd8fbae49bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:01.935780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ce1b641c-eff8-4aba-98db-edd8fbae49bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:01.936556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ce1b641c-eff8-4aba-98db-edd8fbae49bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:01.937020 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ce1b641c-eff8-4aba-98db-edd8fbae49bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:02.072835 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ce1b641c-eff8-4aba-98db-edd8fbae49bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:02.080513 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ce1b641c-eff8-4aba-98db-edd8fbae49bb tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1557 microversion: 2.1 time: 0.156886 May 18 17:13:02.081088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 328/669] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:01 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:02.100687 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3c43bb6c-37a7-4e57-be53-12177e297892 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:02.101296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3c43bb6c-37a7-4e57-be53-12177e297892 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:02.108082 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3c43bb6c-37a7-4e57-be53-12177e297892 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:02.108537 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3c43bb6c-37a7-4e57-be53-12177e297892 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:02.109318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3c43bb6c-37a7-4e57-be53-12177e297892 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:02.109858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3c43bb6c-37a7-4e57-be53-12177e297892 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:02.205848 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3c43bb6c-37a7-4e57-be53-12177e297892 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109978 May 18 17:13:02.206452 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 342/670] 10.222.0.49 () {58 vars in 1274 bytes} [Wed May 18 17:13:02 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:03.373905 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-af64165f-344c-48e5-be76-4656e66c3fcc req-f60fa04c-795c-42db-811a-dc7a2b343192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dc5c540-cca9-45b1-8f26-a3a7e20726fc", "tag": "b64cd2ca-bae4-4611-99a1-1520fac5e7f4"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:03.382473 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-af64165f-344c-48e5-be76-4656e66c3fcc req-f60fa04c-795c-42db-811a-dc7a2b343192 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:03.382919 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-af64165f-344c-48e5-be76-4656e66c3fcc req-f60fa04c-795c-42db-811a-dc7a2b343192 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:03.393996 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-af64165f-344c-48e5-be76-4656e66c3fcc req-f60fa04c-795c-42db-811a-dc7a2b343192 service nova] Creating event network-changed:b64cd2ca-bae4-4611-99a1-1520fac5e7f4 for instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc on hv-cinder-79578 May 18 17:13:03.399377 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-af64165f-344c-48e5-be76-4656e66c3fcc req-f60fa04c-795c-42db-811a-dc7a2b343192 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029066 May 18 17:13:03.399979 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 329/671] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:22.495652 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:22.496406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=35 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:22.501414 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3a6dd7be-649c-4941-9adb-4e990525f28b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:22.501936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3a6dd7be-649c-4941-9adb-4e990525f28b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:22.510138 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a6dd7be-649c-4941-9adb-4e990525f28b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:22.510595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a6dd7be-649c-4941-9adb-4e990525f28b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:22.511356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a6dd7be-649c-4941-9adb-4e990525f28b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:22.511795 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a6dd7be-649c-4941-9adb-4e990525f28b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:22.642446 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-3a6dd7be-649c-4941-9adb-4e990525f28b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lazy-loading 'services' on Instance uuid 547563fc-2b40-4782-be59-1e1dfcbae2e9 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:13:22.759482 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3a6dd7be-649c-4941-9adb-4e990525f28b tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "DELETE /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments/e2e11d29-dfbf-450c-9f9e-70c351788920" status: 202 len: 0 microversion: 2.1 time: 0.265368 May 18 17:13:22.760388 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 343/672] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:13:22 2022] DELETE /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments/e2e11d29-dfbf-450c-9f9e-70c351788920 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:13:22.767358 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:22.768612 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=31 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:22.773398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8e64b3a8-7c5d-4c5f-8de1-cfa3a39e3c7a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:22.774461 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8e64b3a8-7c5d-4c5f-8de1-cfa3a39e3c7a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:22.783483 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e64b3a8-7c5d-4c5f-8de1-cfa3a39e3c7a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:22.783974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e64b3a8-7c5d-4c5f-8de1-cfa3a39e3c7a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:22.784848 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e64b3a8-7c5d-4c5f-8de1-cfa3a39e3c7a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:22.786027 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e64b3a8-7c5d-4c5f-8de1-cfa3a39e3c7a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:22.817878 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8e64b3a8-7c5d-4c5f-8de1-cfa3a39e3c7a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052397 May 18 17:13:22.818665 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 330/673] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:13:22 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:23.830367 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c1a8bbaa-9178-41b1-860a-26b58b7019f0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:23.831440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c1a8bbaa-9178-41b1-860a-26b58b7019f0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:23.839483 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c1a8bbaa-9178-41b1-860a-26b58b7019f0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:23.839942 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c1a8bbaa-9178-41b1-860a-26b58b7019f0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:23.840724 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c1a8bbaa-9178-41b1-860a-26b58b7019f0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:23.841444 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c1a8bbaa-9178-41b1-860a-26b58b7019f0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:23.872412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c1a8bbaa-9178-41b1-860a-26b58b7019f0 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046388 May 18 17:13:23.872987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 344/674] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:13:23 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:24.883546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c7056cd9-4fab-4e78-a5e9-10ef248f1bf5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:24.884453 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c7056cd9-4fab-4e78-a5e9-10ef248f1bf5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:24.890806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7056cd9-4fab-4e78-a5e9-10ef248f1bf5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:24.891247 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7056cd9-4fab-4e78-a5e9-10ef248f1bf5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:24.891996 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7056cd9-4fab-4e78-a5e9-10ef248f1bf5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:24.892422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c7056cd9-4fab-4e78-a5e9-10ef248f1bf5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:24.921289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c7056cd9-4fab-4e78-a5e9-10ef248f1bf5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041649 May 18 17:13:24.921872 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 331/675] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:13:24 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 17:13:25.000146 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3b5675a6-b959-40e1-bbde-2ec548447c19 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:25.000690 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3b5675a6-b959-40e1-bbde-2ec548447c19 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:25.008324 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b5675a6-b959-40e1-bbde-2ec548447c19 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:25.008765 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b5675a6-b959-40e1-bbde-2ec548447c19 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:25.009525 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b5675a6-b959-40e1-bbde-2ec548447c19 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:25.009996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b5675a6-b959-40e1-bbde-2ec548447c19 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:25.035029 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3b5675a6-b959-40e1-bbde-2ec548447c19 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:13:25.111807 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3b5675a6-b959-40e1-bbde-2ec548447c19 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "DELETE /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 204 len: 0 microversion: 2.1 time: 0.115074 May 18 17:13:25.112540 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 345/676] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:13:24 2022] DELETE /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:13:25.121832 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-453ffe7f-55c9-4b0e-9407-327556da0686 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:25.122435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-453ffe7f-55c9-4b0e-9407-327556da0686 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:25.129516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-453ffe7f-55c9-4b0e-9407-327556da0686 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:25.130130 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-453ffe7f-55c9-4b0e-9407-327556da0686 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:25.130918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-453ffe7f-55c9-4b0e-9407-327556da0686 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:25.131354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-453ffe7f-55c9-4b0e-9407-327556da0686 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:25.267640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-453ffe7f-55c9-4b0e-9407-327556da0686 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:25.276549 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-453ffe7f-55c9-4b0e-9407-327556da0686 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1692 microversion: 2.1 time: 0.158674 May 18 17:13:25.277126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 332/677] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:25 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:13:26.295913 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-84565642-7820-461c-895d-d57d51d1eb9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:26.296636 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-84565642-7820-461c-895d-d57d51d1eb9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:26.303324 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84565642-7820-461c-895d-d57d51d1eb9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:26.303766 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84565642-7820-461c-895d-d57d51d1eb9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:26.304539 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84565642-7820-461c-895d-d57d51d1eb9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:26.304976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-84565642-7820-461c-895d-d57d51d1eb9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:26.461046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-84565642-7820-461c-895d-d57d51d1eb9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:26.469178 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-84565642-7820-461c-895d-d57d51d1eb9f tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1692 microversion: 2.1 time: 0.177463 May 18 17:13:26.469765 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 346/678] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:26 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1692 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:27.487554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a663b810-e36b-4bda-a06d-cd9745ac67da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:27.488194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a663b810-e36b-4bda-a06d-cd9745ac67da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:27.495626 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a663b810-e36b-4bda-a06d-cd9745ac67da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:27.496120 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a663b810-e36b-4bda-a06d-cd9745ac67da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:27.496938 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a663b810-e36b-4bda-a06d-cd9745ac67da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:27.497400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a663b810-e36b-4bda-a06d-cd9745ac67da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:27.628179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a663b810-e36b-4bda-a06d-cd9745ac67da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:27.635664 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a663b810-e36b-4bda-a06d-cd9745ac67da tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1692 microversion: 2.1 time: 0.152268 May 18 17:13:27.636232 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 333/679] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:27 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:28.652719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f361c4b7-720a-4de6-abd9-f50722513b89 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:28.653331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f361c4b7-720a-4de6-abd9-f50722513b89 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:28.660146 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f361c4b7-720a-4de6-abd9-f50722513b89 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:28.660757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f361c4b7-720a-4de6-abd9-f50722513b89 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:28.661386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f361c4b7-720a-4de6-abd9-f50722513b89 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:28.661852 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f361c4b7-720a-4de6-abd9-f50722513b89 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:28.800437 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f361c4b7-720a-4de6-abd9-f50722513b89 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:28.810298 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f361c4b7-720a-4de6-abd9-f50722513b89 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1692 microversion: 2.1 time: 0.161249 May 18 17:13:28.810918 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 347/680] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:28 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1692 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:29.828751 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9de1187c-240a-4ee2-bf01-12b50ba195e7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:29.829370 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9de1187c-240a-4ee2-bf01-12b50ba195e7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:29.837355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9de1187c-240a-4ee2-bf01-12b50ba195e7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:29.838250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9de1187c-240a-4ee2-bf01-12b50ba195e7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:29.839439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9de1187c-240a-4ee2-bf01-12b50ba195e7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:29.840573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9de1187c-240a-4ee2-bf01-12b50ba195e7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:29.906263 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9de1187c-240a-4ee2-bf01-12b50ba195e7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:29.917629 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9de1187c-240a-4ee2-bf01-12b50ba195e7 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 200 len: 1624 microversion: 2.1 time: 0.092793 May 18 17:13:29.918251 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 334/681] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:29 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 1624 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:30.017782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-d68f4ba5-267d-4dc0-bb3e-fdc44971c25a req-5a7a225d-eee8-49d9-86a4-72d35a32e9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547563fc-2b40-4782-be59-1e1dfcbae2e9", "name": "network-vif-deleted", "tag": "97903cf8-6adc-4750-9dcb-7e5cd03b095f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:30.030348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d68f4ba5-267d-4dc0-bb3e-fdc44971c25a req-5a7a225d-eee8-49d9-86a4-72d35a32e9f7 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:30.031500 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-d68f4ba5-267d-4dc0-bb3e-fdc44971c25a req-5a7a225d-eee8-49d9-86a4-72d35a32e9f7 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:30.049476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-d68f4ba5-267d-4dc0-bb3e-fdc44971c25a req-5a7a225d-eee8-49d9-86a4-72d35a32e9f7 service nova] Creating event network-vif-deleted:97903cf8-6adc-4750-9dcb-7e5cd03b095f for instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 on hv-cinder-79578 May 18 17:13:30.058718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-d68f4ba5-267d-4dc0-bb3e-fdc44971c25a req-5a7a225d-eee8-49d9-86a4-72d35a32e9f7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044129 May 18 17:13:30.059638 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 348/682] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:30.937608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:30.938388 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 547563fc-2b40-4782-be59-1e1dfcbae2e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:30.946259 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:30.946259 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:30.947104 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:30.947468 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:30.962544 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] HTTP exception thrown: Instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 could not be found. May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Request method failure captured: May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 HTTP/1.1 May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd7mhZqsvU-pGf7jhqBpZwoFEOMD7ZgntriICrKuuArePuDRkM58WnyFUIbPMb6g9J-eLPYfmczvVnkU2koaO0drl2hFLltVrrisVCkxp8Il7eqoibvrfNlsnqG5atcXRhjgVIjaLVxdAxtFvtgzQ8XDIuoZV8Tlq_cEpRqksjRaYo May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:13:30.964183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 5e28c0ca22d143eebe6fc93f85442a7f May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 could not be found. May 18 17:13:30.966734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '547563fc-2b40-4782-be59-1e1dfcbae2e9'} May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 could not be found. May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:13:30.967643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 could not be found. May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 could not be found. May 18 17:13:30.969133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:30.970489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Returning 404 to user: Instance 547563fc-2b40-4782-be59-1e1dfcbae2e9 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:13:30.970489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ecd4d495-3962-4afb-bfe1-66136c7870e4 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9" status: 404 len: 111 microversion: 2.1 time: 0.031979 May 18 17:13:30.970489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 335/683] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:30 2022] GET /compute/v2.1/servers/547563fc-2b40-4782-be59-1e1dfcbae2e9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:13:30.975684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9f61dd5b-06fe-4af0-af7a-a9247d6f56d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '.version_select at 0x7feef3bc58b0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:30.993954 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9f61dd5b-06fe-4af0-af7a-a9247d6f56d9 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557598847" status: 202 len: 0 microversion: 2.1 time: 0.022836 May 18 17:13:30.994532 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 349/684] 10.222.0.49 () {58 vars in 1220 bytes} [Wed May 18 17:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1557598847 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 17:13:33.963170 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1282e067-817e-4367-b2ad-a4a97cbf99e5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:33.963740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1282e067-817e-4367-b2ad-a4a97cbf99e5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:33.969959 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1282e067-817e-4367-b2ad-a4a97cbf99e5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:33.970399 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1282e067-817e-4367-b2ad-a4a97cbf99e5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:33.971153 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1282e067-817e-4367-b2ad-a4a97cbf99e5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:33.971579 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1282e067-817e-4367-b2ad-a4a97cbf99e5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:33.998999 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1282e067-817e-4367-b2ad-a4a97cbf99e5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:13:34.088350 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1282e067-817e-4367-b2ad-a4a97cbf99e5 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "DELETE /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 204 len: 0 microversion: 2.1 time: 0.129839 May 18 17:13:34.088928 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 336/685] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:13:33 2022] DELETE /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:13:34.097782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-42be7403-0bad-4280-bef1-d1f9638dd915 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:34.098515 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-42be7403-0bad-4280-bef1-d1f9638dd915 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:34.105281 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-42be7403-0bad-4280-bef1-d1f9638dd915 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:34.105772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-42be7403-0bad-4280-bef1-d1f9638dd915 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:34.106553 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-42be7403-0bad-4280-bef1-d1f9638dd915 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:34.106991 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-42be7403-0bad-4280-bef1-d1f9638dd915 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:34.245936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-42be7403-0bad-4280-bef1-d1f9638dd915 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:34.253476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-42be7403-0bad-4280-bef1-d1f9638dd915 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1508 microversion: 2.1 time: 0.160197 May 18 17:13:34.254435 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 350/686] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:34 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:35.272584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-85bc9a9c-06fb-4408-be34-483cc7667e65 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:35.273202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-85bc9a9c-06fb-4408-be34-483cc7667e65 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:35.279754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85bc9a9c-06fb-4408-be34-483cc7667e65 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:35.280203 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85bc9a9c-06fb-4408-be34-483cc7667e65 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:35.280968 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85bc9a9c-06fb-4408-be34-483cc7667e65 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:35.281403 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85bc9a9c-06fb-4408-be34-483cc7667e65 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:35.417599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-85bc9a9c-06fb-4408-be34-483cc7667e65 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:35.425237 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-85bc9a9c-06fb-4408-be34-483cc7667e65 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1508 microversion: 2.1 time: 0.157639 May 18 17:13:35.425899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 337/687] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:35 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:35.853908 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-6b8b56b5-b774-4297-90d8-e491d86d0d63 req-884bb986-71fd-4372-a40c-3e506d0cac18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f5c3626-81f9-412a-9759-82527b75e30e", "name": "network-vif-deleted", "tag": "8a8ee3d0-ac7c-4e62-9f8b-23af1601e83f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:35.867190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-6b8b56b5-b774-4297-90d8-e491d86d0d63 req-884bb986-71fd-4372-a40c-3e506d0cac18 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:35.867629 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-6b8b56b5-b774-4297-90d8-e491d86d0d63 req-884bb986-71fd-4372-a40c-3e506d0cac18 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:35.881601 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-6b8b56b5-b774-4297-90d8-e491d86d0d63 req-884bb986-71fd-4372-a40c-3e506d0cac18 service nova] Creating event network-vif-deleted:8a8ee3d0-ac7c-4e62-9f8b-23af1601e83f for instance 7f5c3626-81f9-412a-9759-82527b75e30e on hv-cinder-79578 May 18 17:13:35.888103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-6b8b56b5-b774-4297-90d8-e491d86d0d63 req-884bb986-71fd-4372-a40c-3e506d0cac18 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037838 May 18 17:13:35.889014 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 351/688] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:36.442290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:36.443431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:36.449393 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:36.449952 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:36.450970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:36.451404 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:36.485733 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:36.486182 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:36.486631 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lazy-loading 'fault' on Instance uuid 7f5c3626-81f9-412a-9759-82527b75e30e {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:13:36.531251 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:36.539470 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a5e588c5-91f4-41ae-bab7-6782c1ac6bb2 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 200 len: 1312 microversion: 2.1 time: 0.101826 May 18 17:13:36.540196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 338/689] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:36 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 1312 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:36.906576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b3e4a83f-2ec6-42ea-bdc3-ac4d4e9ebe0e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:36.907165 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b3e4a83f-2ec6-42ea-bdc3-ac4d4e9ebe0e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:36.913366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b3e4a83f-2ec6-42ea-bdc3-ac4d4e9ebe0e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:36.913855 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b3e4a83f-2ec6-42ea-bdc3-ac4d4e9ebe0e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:36.914631 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b3e4a83f-2ec6-42ea-bdc3-ac4d4e9ebe0e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:36.915071 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b3e4a83f-2ec6-42ea-bdc3-ac4d4e9ebe0e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:36.946447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b3e4a83f-2ec6-42ea-bdc3-ac4d4e9ebe0e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments/2ab1e63f-df04-4e53-9e06-1b1aa1d6a8ea" status: 200 len: 194 microversion: 2.20 time: 0.160005 May 18 17:13:36.947043 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 352/690] 10.222.0.49 () {60 vars in 1453 bytes} [Wed May 18 17:13:36 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments/2ab1e63f-df04-4e53-9e06-1b1aa1d6a8ea => generated 194 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:13:37.012278 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e0a690c1-9d15-43ac-8acb-c5a9fbc45114 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:37.012806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e0a690c1-9d15-43ac-8acb-c5a9fbc45114 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:37.019309 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0a690c1-9d15-43ac-8acb-c5a9fbc45114 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.019760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0a690c1-9d15-43ac-8acb-c5a9fbc45114 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.020593 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0a690c1-9d15-43ac-8acb-c5a9fbc45114 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.021931 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e0a690c1-9d15-43ac-8acb-c5a9fbc45114 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.104558 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-e0a690c1-9d15-43ac-8acb-c5a9fbc45114 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lazy-loading 'services' on Instance uuid e9559237-c858-41a6-ba99-09106ba78496 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:13:37.176888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e0a690c1-9d15-43ac-8acb-c5a9fbc45114 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments/2ab1e63f-df04-4e53-9e06-1b1aa1d6a8ea" status: 202 len: 0 microversion: 2.20 time: 0.168516 May 18 17:13:37.177810 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 339/691] 10.222.0.49 () {60 vars in 1456 bytes} [Wed May 18 17:13:37 2022] DELETE /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments/2ab1e63f-df04-4e53-9e06-1b1aa1d6a8ea => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 17:13:37.189919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-42da1a64-5d0c-4beb-8198-af4ed487a537 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:37.191554 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-42da1a64-5d0c-4beb-8198-af4ed487a537 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:37.201356 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-42da1a64-5d0c-4beb-8198-af4ed487a537 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.202175 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-42da1a64-5d0c-4beb-8198-af4ed487a537 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.203487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-42da1a64-5d0c-4beb-8198-af4ed487a537 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.204225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-42da1a64-5d0c-4beb-8198-af4ed487a537 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.240629 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-42da1a64-5d0c-4beb-8198-af4ed487a537 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057081 May 18 17:13:37.241441 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 353/692] 10.222.0.49 () {60 vars in 1342 bytes} [Wed May 18 17:13:37 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:13:37.558354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:37.559065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 7f5c3626-81f9-412a-9759-82527b75e30e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:37.565423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.565914 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.566697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.567165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.584396 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] HTTP exception thrown: Instance 7f5c3626-81f9-412a-9759-82527b75e30e could not be found. May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Request method failure captured: May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e HTTP/1.1 May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd7mhZqsvU-pGf7jhqBpZwoFEOMD7ZgntriICrKuuArePuDRkM58WnyFUIbPMb6g9J-eLPYfmczvVnkU2koaO0drl2hFLltVrrisVCkxp8Il7eqoibvrfNlsnqG5atcXRhjgVIjaLVxdAxtFvtgzQ8XDIuoZV8Tlq_cEpRqksjRaYo May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:13:37.586108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 5e28c0ca22d143eebe6fc93f85442a7f May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 7f5c3626-81f9-412a-9759-82527b75e30e could not be found. May 18 17:13:37.587587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '7f5c3626-81f9-412a-9759-82527b75e30e'} May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f5c3626-81f9-412a-9759-82527b75e30e could not be found. May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:13:37.588320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f5c3626-81f9-412a-9759-82527b75e30e could not be found. May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f5c3626-81f9-412a-9759-82527b75e30e could not be found. May 18 17:13:37.589543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:37.590799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Returning 404 to user: Instance 7f5c3626-81f9-412a-9759-82527b75e30e could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:13:37.590799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e9d1cd02-db7c-4003-bfae-00c6cb14879a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e" status: 404 len: 111 microversion: 2.1 time: 0.034040 May 18 17:13:37.590799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 340/693] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:37 2022] GET /compute/v2.1/servers/7f5c3626-81f9-412a-9759-82527b75e30e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:13:37.596512 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b7199a3e-78e6-4817-bc99-68e2a40b3187 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:37.597013 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b7199a3e-78e6-4817-bc99-68e2a40b3187 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:37.603204 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7199a3e-78e6-4817-bc99-68e2a40b3187 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.603648 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7199a3e-78e6-4817-bc99-68e2a40b3187 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.604412 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7199a3e-78e6-4817-bc99-68e2a40b3187 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.604857 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b7199a3e-78e6-4817-bc99-68e2a40b3187 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.632363 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b7199a3e-78e6-4817-bc99-68e2a40b3187 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:13:37.714673 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b7199a3e-78e6-4817-bc99-68e2a40b3187 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 204 len: 0 microversion: 2.1 time: 0.121698 May 18 17:13:37.715255 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 354/694] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:13:37 2022] DELETE /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:13:37.725214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d4f9697f-58d7-4bbb-9d5b-0360f6445428 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:37.725945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d4f9697f-58d7-4bbb-9d5b-0360f6445428 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:37.732470 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4f9697f-58d7-4bbb-9d5b-0360f6445428 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.732924 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4f9697f-58d7-4bbb-9d5b-0360f6445428 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.733792 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4f9697f-58d7-4bbb-9d5b-0360f6445428 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:37.734238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4f9697f-58d7-4bbb-9d5b-0360f6445428 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:37.869065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4f9697f-58d7-4bbb-9d5b-0360f6445428 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:37.877146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d4f9697f-58d7-4bbb-9d5b-0360f6445428 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.157244 May 18 17:13:37.877744 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 341/695] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:37 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:38.253210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5bc9df7f-83de-4341-9aee-cff656baa6a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:38.254237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5bc9df7f-83de-4341-9aee-cff656baa6a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:38.261713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5bc9df7f-83de-4341-9aee-cff656baa6a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:38.262172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5bc9df7f-83de-4341-9aee-cff656baa6a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:38.262945 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5bc9df7f-83de-4341-9aee-cff656baa6a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:38.263414 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5bc9df7f-83de-4341-9aee-cff656baa6a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:38.295307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5bc9df7f-83de-4341-9aee-cff656baa6a3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046395 May 18 17:13:38.295882 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 355/696] 10.222.0.49 () {60 vars in 1342 bytes} [Wed May 18 17:13:38 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:13:38.895230 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-87e8d8a5-8781-428f-a2a1-6f6aab0e38bd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:38.896414 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-87e8d8a5-8781-428f-a2a1-6f6aab0e38bd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:38.903140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-87e8d8a5-8781-428f-a2a1-6f6aab0e38bd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:38.903595 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-87e8d8a5-8781-428f-a2a1-6f6aab0e38bd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:38.904360 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-87e8d8a5-8781-428f-a2a1-6f6aab0e38bd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:38.904800 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-87e8d8a5-8781-428f-a2a1-6f6aab0e38bd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:39.291493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-87e8d8a5-8781-428f-a2a1-6f6aab0e38bd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:39.303912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-87e8d8a5-8781-428f-a2a1-6f6aab0e38bd tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.412630 May 18 17:13:39.313432 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 342/697] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:38 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:39.313679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02110617-8760-4f4d-87a2-4052eb99659b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:39.313679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02110617-8760-4f4d-87a2-4052eb99659b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:39.318734 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02110617-8760-4f4d-87a2-4052eb99659b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:39.319453 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02110617-8760-4f4d-87a2-4052eb99659b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:39.321166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02110617-8760-4f4d-87a2-4052eb99659b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:39.321738 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02110617-8760-4f4d-87a2-4052eb99659b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:39.360939 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02110617-8760-4f4d-87a2-4052eb99659b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057333 May 18 17:13:39.361551 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 356/698] 10.222.0.49 () {60 vars in 1342 bytes} [Wed May 18 17:13:39 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:13:39.426088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f93f55db-b966-477d-b1cf-bd675bb68847 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:39.426585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f93f55db-b966-477d-b1cf-bd675bb68847 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:39.432975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f93f55db-b966-477d-b1cf-bd675bb68847 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:39.433425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f93f55db-b966-477d-b1cf-bd675bb68847 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:39.434280 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f93f55db-b966-477d-b1cf-bd675bb68847 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:39.434709 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f93f55db-b966-477d-b1cf-bd675bb68847 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:39.462690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f93f55db-b966-477d-b1cf-bd675bb68847 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:13:39.510497 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:39.545064 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f93f55db-b966-477d-b1cf-bd675bb68847 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 204 len: 0 microversion: 2.20 time: 0.122803 May 18 17:13:39.545649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 343/699] 10.222.0.49 () {60 vars in 1279 bytes} [Wed May 18 17:13:39 2022] DELETE /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 17:13:39.555237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:39.555861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:39.562038 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:39.562495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:39.563277 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:39.563715 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:39.740001 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:39.743642 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:39.749319 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:39.750848 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:39.751992 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-91e5f46f-90c6-4509-b30a-d99b34f2fca2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.201801 May 18 17:13:39.752551 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 357/700] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:39 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:13:40.322503 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6684eba7-096e-4ab6-bd34-5803d0b1e05e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:40.323116 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6684eba7-096e-4ab6-bd34-5803d0b1e05e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:40.329745 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6684eba7-096e-4ab6-bd34-5803d0b1e05e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:40.330201 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6684eba7-096e-4ab6-bd34-5803d0b1e05e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:40.330966 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6684eba7-096e-4ab6-bd34-5803d0b1e05e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:40.331408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6684eba7-096e-4ab6-bd34-5803d0b1e05e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:40.464549 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6684eba7-096e-4ab6-bd34-5803d0b1e05e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:40.472608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6684eba7-096e-4ab6-bd34-5803d0b1e05e tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1523 microversion: 2.1 time: 0.154642 May 18 17:13:40.473184 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 344/701] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:40 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:40.773182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:40.773878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:40.781804 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:40.782259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:40.783032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:40.783473 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:40.918742 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:40.926731 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:40.928733 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:40.929921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e68455b9-c27c-42ef-8fae-060fad72a0c5 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.161615 May 18 17:13:40.930473 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 358/702] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:40 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:41.430838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-b78d3468-8fc9-46d4-b73a-45737c77b556 req-5395627b-42fa-4074-8317-77d75fb37c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a1e5ac3-2af5-4bee-a830-1f6014618699", "name": "network-vif-deleted", "tag": "48153f9f-0291-4a2d-98eb-9f34883f13df"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:41.440852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b78d3468-8fc9-46d4-b73a-45737c77b556 req-5395627b-42fa-4074-8317-77d75fb37c2c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:41.441435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b78d3468-8fc9-46d4-b73a-45737c77b556 req-5395627b-42fa-4074-8317-77d75fb37c2c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:41.453632 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-b78d3468-8fc9-46d4-b73a-45737c77b556 req-5395627b-42fa-4074-8317-77d75fb37c2c service nova] Creating event network-vif-deleted:48153f9f-0291-4a2d-98eb-9f34883f13df for instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 on hv-cinder-79578 May 18 17:13:41.460768 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-b78d3468-8fc9-46d4-b73a-45737c77b556 req-5395627b-42fa-4074-8317-77d75fb37c2c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034039 May 18 17:13:41.461431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 345/703] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:41.490807 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c4d53885-51a9-437c-9302-44df90c3f169 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:41.491421 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c4d53885-51a9-437c-9302-44df90c3f169 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:41.497414 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c4d53885-51a9-437c-9302-44df90c3f169 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:41.497898 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c4d53885-51a9-437c-9302-44df90c3f169 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:41.498664 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c4d53885-51a9-437c-9302-44df90c3f169 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:41.499094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c4d53885-51a9-437c-9302-44df90c3f169 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:41.560807 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c4d53885-51a9-437c-9302-44df90c3f169 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e28c0ca22d143eebe6fc93f85442a7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af6df110a2604ba3adab104ec1decf4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:41.569046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c4d53885-51a9-437c-9302-44df90c3f169 tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 200 len: 1481 microversion: 2.1 time: 0.082768 May 18 17:13:41.569631 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 359/704] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:41 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 1481 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:41.950081 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:41.950711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:41.957699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:41.958381 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:41.959240 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:41.959680 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:42.117399 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:42.126853 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:42.128454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:42.129692 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9fea4bed-986d-4189-8f73-60f4806abf14 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1723 microversion: 2.20 time: 0.184214 May 18 17:13:42.131188 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 346/705] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:41 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:42.586799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:42.587485 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] [instance: 8a1e5ac3-2af5-4bee-a830-1f6014618699] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:42.594717 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:42.595176 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:42.595966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:42.596426 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:42.612664 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] HTTP exception thrown: Instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 could not be found. May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Request method failure captured: May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 HTTP/1.1 May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd7mhZqsvU-pGf7jhqBpZwoFEOMD7ZgntriICrKuuArePuDRkM58WnyFUIbPMb6g9J-eLPYfmczvVnkU2koaO0drl2hFLltVrrisVCkxp8Il7eqoibvrfNlsnqG5atcXRhjgVIjaLVxdAxtFvtgzQ8XDIuoZV8Tlq_cEpRqksjRaYo May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:13:42.614879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/af6df110a2604ba3adab104ec1decf4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: af6df110a2604ba3adab104ec1decf4c May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2092074906 May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 5e28c0ca22d143eebe6fc93f85442a7f May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2092074906-project May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 could not be found. May 18 17:13:42.616713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '8a1e5ac3-2af5-4bee-a830-1f6014618699'} May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 could not be found. May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:13:42.621825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 could not be found. May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 could not be found. May 18 17:13:42.624670 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:13:42.627878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] Returning 404 to user: Instance 8a1e5ac3-2af5-4bee-a830-1f6014618699 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:13:42.627878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-db71e92e-81d3-472b-9736-1f275f8b589a tempest-ServerRescueNegativeTestJSON-2092074906 tempest-ServerRescueNegativeTestJSON-2092074906-project] 10.222.0.49 "GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699" status: 404 len: 111 microversion: 2.1 time: 0.035057 May 18 17:13:42.627878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 360/706] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:42 2022] GET /compute/v2.1/servers/8a1e5ac3-2af5-4bee-a830-1f6014618699 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:13:43.150460 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:43.151864 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:43.164021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:43.164551 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:43.165902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:43.166676 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:43.243426 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:43.243923 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:43.244434 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lazy-loading 'fault' on Instance uuid e9559237-c858-41a6-ba99-09106ba78496 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:13:43.305747 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:43.321280 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:43.324391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:43.327463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-531f5c76-116c-41f1-a15a-731eb9047ead tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 200 len: 1371 microversion: 2.20 time: 0.181590 May 18 17:13:43.328959 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 347/707] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:43 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:13:43.477124 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-a2b0efd6-cc02-42af-b2b6-d434eeb1877e req-daffa187-e1ca-416b-9d59-f66c00bf650e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9559237-c858-41a6-ba99-09106ba78496", "name": "network-vif-deleted", "tag": "a59f32ad-7870-4083-b0d4-262a85cedd52"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:43.487458 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a2b0efd6-cc02-42af-b2b6-d434eeb1877e req-daffa187-e1ca-416b-9d59-f66c00bf650e service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:43.488429 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a2b0efd6-cc02-42af-b2b6-d434eeb1877e req-daffa187-e1ca-416b-9d59-f66c00bf650e service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:43.501625 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-a2b0efd6-cc02-42af-b2b6-d434eeb1877e req-daffa187-e1ca-416b-9d59-f66c00bf650e service nova] Creating event network-vif-deleted:a59f32ad-7870-4083-b0d4-262a85cedd52 for instance e9559237-c858-41a6-ba99-09106ba78496 on hv-cinder-79578 May 18 17:13:43.508180 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-a2b0efd6-cc02-42af-b2b6-d434eeb1877e req-daffa187-e1ca-416b-9d59-f66c00bf650e service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035215 May 18 17:13:43.509236 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 361/708] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:44.346722 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:44.347315 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:44.355613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:44.356079 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:44.356896 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:44.357282 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:44.372270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] HTTP exception thrown: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Request method failure captured: May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 HTTP/1.1 May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSff22o0cI_fLCy985cFcaEiKyv8HxWqd1EtYKSXOCJSS_bGKFdKh5G5hfk7RekHwotcAC4D4YVMDvgVLJ19P67P8xNzeA3bBm8oEDgfFHY0ts2D-DUgVi984qmKZRgf9GXeU7aqa_FxVHyqmNvfmAoSIxTz11Qr1ZcXKjNk9B-sZuU May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Openstack-Nova-Api-Version: 2.20 May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:13:44.373973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 13b9ab17cee74e8282cd86a37eaf19aa May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:13:44.375534 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'e9559237-c858-41a6-ba99-09106ba78496'} May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:13:44.376516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:13:44.377946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:44.379291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Returning 404 to user: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:13:44.379291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-42fe8dbc-3102-438c-baac-cfa764939d73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 404 len: 111 microversion: 2.20 time: 0.032863 May 18 17:13:44.379291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 348/709] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:44 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 17:13:44.393117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bb5a96da-be75-47e5-aa58-40b4f8b902af tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '.version_select at 0x7feef3a9fdc0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:44.414538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bb5a96da-be75-47e5-aa58-40b4f8b902af tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-445549978" status: 204 len: 0 microversion: 2.20 time: 0.031996 May 18 17:13:44.415115 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 362/710] 10.222.0.49 () {60 vars in 1258 bytes} [Wed May 18 17:13:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-445549978 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 18 17:13:45.184085 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ceea1808-b749-4c50-be7e-22661216b26d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'create', calling method: .version_select at 0x7fef002413a0>, body: {"keypair": {"name": "tempest-keypair-1055811079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHghOusXVVa3VEJk39l2+k1C5WJZ1n39Jdcyz897m+G6elNpf1GUDvDE9twWFj/rnPH1+IEmfxd4n2N3P5z2jluviyD9XhGhaIhE/8P1KRMjLXMk10y8scNcPlws4coaOw=="}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:45.200159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-ceea1808-b749-4c50-be7e-22661216b26d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Getting quotas for project 6fe001ad764a40839c0a87e48dedb14f. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:13:45.204538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-ceea1808-b749-4c50-be7e-22661216b26d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Getting quotas for user 13b9ab17cee74e8282cd86a37eaf19aa and project 6fe001ad764a40839c0a87e48dedb14f. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:13:45.229686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ceea1808-b749-4c50-be7e-22661216b26d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049623 May 18 17:13:45.230309 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 349/711] 10.222.0.49 () {62 vars in 1199 bytes} [Wed May 18 17:13:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 18 17:13:46.687351 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1530778471", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "befffa0d-bc76-4fb5-90a1-9d8502254252"}], "security_groups": [{"name": "tempest-securitygroup--13255603"}], "key_name": "tempest-keypair-1055811079", "user_data": "}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:46.819516 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] validate_networks() for [('befffa0d-bc76-4fb5-90a1-9d8502254252', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:13:47.285082 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:13:47.285921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:13:47.287390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:13:47.288139 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:13:47.288912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:13:47.306828 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:47.307286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:47.308086 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:47.308518 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:47.327022 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Getting quotas for project 6fe001ad764a40839c0a87e48dedb14f. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:13:47.331129 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Getting quotas for user 13b9ab17cee74e8282cd86a37eaf19aa and project 6fe001ad764a40839c0a87e48dedb14f. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:13:47.343558 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:13:47.346010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:13:47.406789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3a0b0745-0f89-421b-a2e5-8b84c411eb73 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 0.724779 May 18 17:13:47.407951 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 363/712] 10.222.0.49 () {62 vars in 1187 bytes} [Wed May 18 17:13:46 2022] POST /compute/v2.1/servers => generated 400 bytes in 726 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 18 17:13:47.418778 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cbf04492-863c-4eb7-8c40-2bc234078f81 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:47.419712 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cbf04492-863c-4eb7-8c40-2bc234078f81 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:47.482327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cbf04492-863c-4eb7-8c40-2bc234078f81 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:47.491031 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cbf04492-863c-4eb7-8c40-2bc234078f81 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:47.492714 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cbf04492-863c-4eb7-8c40-2bc234078f81 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:47.494260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cbf04492-863c-4eb7-8c40-2bc234078f81 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1282 microversion: 2.20 time: 0.080104 May 18 17:13:47.494799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 350/713] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:47 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:48.513529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:48.514317 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:48.526981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:48.527807 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:48.528818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:48.529631 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:48.615365 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:48.625438 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:48.627397 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:48.629019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dc228c3f-5ef0-45c1-b680-bea95de54d70 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1352 microversion: 2.20 time: 0.120109 May 18 17:13:48.630760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 364/714] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:48 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1352 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:49.651023 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:49.652257 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:49.664851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:49.666156 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:49.667113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:49.667832 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:49.842724 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:49.853020 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:49.854802 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:49.856719 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4449e6aa-c64e-43c2-ba4f-8ee7a9391ad7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.210588 May 18 17:13:49.857481 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 351/715] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:49 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:50.209141 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-70abe465-1882-4b02-af08-3d738200825e req-e8be62c1-1eb2-43d5-a59a-4439422e5704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53e5299-6ac2-4849-a4c1-01924709ff00", "tag": "47bc87df-78ea-4da7-8fdc-bd2bd4b75078"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:50.228963 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-70abe465-1882-4b02-af08-3d738200825e req-e8be62c1-1eb2-43d5-a59a-4439422e5704 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.238318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-70abe465-1882-4b02-af08-3d738200825e req-e8be62c1-1eb2-43d5-a59a-4439422e5704 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:50.273516 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-70abe465-1882-4b02-af08-3d738200825e req-e8be62c1-1eb2-43d5-a59a-4439422e5704 service nova] Creating event network-changed:47bc87df-78ea-4da7-8fdc-bd2bd4b75078 for instance f53e5299-6ac2-4849-a4c1-01924709ff00 on hv-cinder-79578 May 18 17:13:50.279399 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-70abe465-1882-4b02-af08-3d738200825e req-e8be62c1-1eb2-43d5-a59a-4439422e5704 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076514 May 18 17:13:50.280121 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 365/716] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:50.314129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8599bb76-f9c5-463e-8691-2c5186936a6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:50.315370 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8599bb76-f9c5-463e-8691-2c5186936a6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:50.322429 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8599bb76-f9c5-463e-8691-2c5186936a6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.323071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8599bb76-f9c5-463e-8691-2c5186936a6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:50.324051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8599bb76-f9c5-463e-8691-2c5186936a6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.324492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8599bb76-f9c5-463e-8691-2c5186936a6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:50.385902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8599bb76-f9c5-463e-8691-2c5186936a6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.075817 May 18 17:13:50.387492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 352/717] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:13:50 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 17:13:50.459850 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2e81c011-3643-4539-93b6-3a468b43f0ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:50.460452 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2e81c011-3643-4539-93b6-3a468b43f0ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:50.467523 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e81c011-3643-4539-93b6-3a468b43f0ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.468500 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e81c011-3643-4539-93b6-3a468b43f0ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:50.469843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e81c011-3643-4539-93b6-3a468b43f0ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.470593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e81c011-3643-4539-93b6-3a468b43f0ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:50.499872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2e81c011-3643-4539-93b6-3a468b43f0ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:13:50.596535 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2e81c011-3643-4539-93b6-3a468b43f0ab tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 204 len: 0 microversion: 2.1 time: 0.140817 May 18 17:13:50.601208 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 366/718] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:13:50 2022] DELETE /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 18 17:13:50.606254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e599b99a-2f00-4489-80c4-346515bbc042 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:50.606866 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e599b99a-2f00-4489-80c4-346515bbc042 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:50.621974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e599b99a-2f00-4489-80c4-346515bbc042 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.622430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e599b99a-2f00-4489-80c4-346515bbc042 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:50.623208 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e599b99a-2f00-4489-80c4-346515bbc042 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.623641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e599b99a-2f00-4489-80c4-346515bbc042 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:50.836699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e599b99a-2f00-4489-80c4-346515bbc042 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:50.845324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e599b99a-2f00-4489-80c4-346515bbc042 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1673 microversion: 2.1 time: 0.242955 May 18 17:13:50.845918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 353/719] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:50 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1673 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:50.880553 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:50.881254 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:50.887289 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.887743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:50.888511 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:50.888946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:51.082252 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:51.093128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:51.094868 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:51.096568 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-17743da0-2ea8-4758-9551-1d7e49dc30b1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.221164 May 18 17:13:51.097556 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 367/720] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:50 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:51.862750 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5ac275b1-c468-49df-8521-5960f260e65a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:51.863370 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5ac275b1-c468-49df-8521-5960f260e65a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:51.870284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ac275b1-c468-49df-8521-5960f260e65a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:51.870743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ac275b1-c468-49df-8521-5960f260e65a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:51.871524 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ac275b1-c468-49df-8521-5960f260e65a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:51.871966 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ac275b1-c468-49df-8521-5960f260e65a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:52.015046 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5ac275b1-c468-49df-8521-5960f260e65a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:52.023650 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5ac275b1-c468-49df-8521-5960f260e65a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1673 microversion: 2.1 time: 0.164678 May 18 17:13:52.024444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 354/721] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:51 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:52.115443 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:52.116249 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:52.122956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:52.123486 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:52.124323 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:52.124827 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:52.539489 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:52.550539 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:52.553337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:52.554626 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-89ecc1cb-83e0-4af2-9193-3349f8f8b122 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.443425 May 18 17:13:52.555473 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 368/722] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:52 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:13:53.042400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5abf5ecf-ab9d-40dd-84a7-62cdbf188234 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:53.043335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5abf5ecf-ab9d-40dd-84a7-62cdbf188234 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:53.045786 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:53.051488 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5abf5ecf-ab9d-40dd-84a7-62cdbf188234 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:53.052249 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5abf5ecf-ab9d-40dd-84a7-62cdbf188234 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:53.053229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5abf5ecf-ab9d-40dd-84a7-62cdbf188234 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:53.053697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5abf5ecf-ab9d-40dd-84a7-62cdbf188234 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:53.210422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5abf5ecf-ab9d-40dd-84a7-62cdbf188234 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:53.218174 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5abf5ecf-ab9d-40dd-84a7-62cdbf188234 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1673 microversion: 2.1 time: 0.179595 May 18 17:13:53.218737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 355/723] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:53 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:53.574186 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:53.574802 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:53.577265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:53.583865 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:53.584313 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:53.585557 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:53.586018 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:53.745954 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:53.754352 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:53.756626 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:53.758050 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b966cba0-7be0-4597-b419-708951b769c1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.188950 May 18 17:13:53.758618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 369/724] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:53 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:13:54.236600 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9ece67c1-8694-4471-a6ae-d9db2fba368a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:54.237276 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9ece67c1-8694-4471-a6ae-d9db2fba368a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:54.244786 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9ece67c1-8694-4471-a6ae-d9db2fba368a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:54.245233 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9ece67c1-8694-4471-a6ae-d9db2fba368a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:54.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9ece67c1-8694-4471-a6ae-d9db2fba368a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:54.246456 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9ece67c1-8694-4471-a6ae-d9db2fba368a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:54.394341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9ece67c1-8694-4471-a6ae-d9db2fba368a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:54.403271 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9ece67c1-8694-4471-a6ae-d9db2fba368a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1673 microversion: 2.1 time: 0.170460 May 18 17:13:54.403851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 356/725] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:54 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:54.776068 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:54.776992 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:54.783440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:54.783896 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:54.784674 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:54.785112 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:54.918073 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:54.926006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:54.928454 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:54.929567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02e5fb6f-37bf-402a-94da-2acc85442261 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.157437 May 18 17:13:54.930152 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 370/726] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:54 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:55.422797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-31442f88-188f-4e29-af01-290f347c1e5c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:55.423437 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-31442f88-188f-4e29-af01-290f347c1e5c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:55.430072 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-31442f88-188f-4e29-af01-290f347c1e5c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:55.430531 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-31442f88-188f-4e29-af01-290f347c1e5c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:55.431519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-31442f88-188f-4e29-af01-290f347c1e5c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:55.431959 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-31442f88-188f-4e29-af01-290f347c1e5c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:55.626174 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-31442f88-188f-4e29-af01-290f347c1e5c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:55.640070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-31442f88-188f-4e29-af01-290f347c1e5c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1673 microversion: 2.1 time: 0.221125 May 18 17:13:55.642304 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 357/727] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:55 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:55.948971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:55.949778 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:55.956989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:55.958880 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:55.960155 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:55.960589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:56.249536 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:56.261172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:56.263325 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:56.264740 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a47f0714-b1bd-4271-b523-ceea2d7bf3e7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.319971 May 18 17:13:56.276418 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 371/728] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:55 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:56.549462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-44d69c2b-7f35-4ee7-8bf1-7a061e739064 req-6199fd53-b87c-48a9-aef5-d403f2138910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "457f8f5f-ff7d-4484-8e29-298c7ecbee76", "name": "network-vif-deleted", "tag": "574aa010-2b32-4402-9aca-f06181af0dc4"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:56.559717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-44d69c2b-7f35-4ee7-8bf1-7a061e739064 req-6199fd53-b87c-48a9-aef5-d403f2138910 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:56.560315 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-44d69c2b-7f35-4ee7-8bf1-7a061e739064 req-6199fd53-b87c-48a9-aef5-d403f2138910 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:56.573008 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-44d69c2b-7f35-4ee7-8bf1-7a061e739064 req-6199fd53-b87c-48a9-aef5-d403f2138910 service nova] Creating event network-vif-deleted:574aa010-2b32-4402-9aca-f06181af0dc4 for instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 on hv-cinder-79578 May 18 17:13:56.578926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-44d69c2b-7f35-4ee7-8bf1-7a061e739064 req-6199fd53-b87c-48a9-aef5-d403f2138910 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033100 May 18 17:13:56.579843 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 358/729] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:56.667568 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-aa99808c-70fc-48f8-a30d-fff63a72d73b tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:56.668209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-aa99808c-70fc-48f8-a30d-fff63a72d73b tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:56.679667 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa99808c-70fc-48f8-a30d-fff63a72d73b tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:56.680436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa99808c-70fc-48f8-a30d-fff63a72d73b tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:56.681820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa99808c-70fc-48f8-a30d-fff63a72d73b tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:56.682426 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-aa99808c-70fc-48f8-a30d-fff63a72d73b tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:56.802892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-aa99808c-70fc-48f8-a30d-fff63a72d73b tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:56.833961 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-aa99808c-70fc-48f8-a30d-fff63a72d73b tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 200 len: 1321 microversion: 2.1 time: 0.176056 May 18 17:13:56.837231 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 372/730] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:56 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:13:57.286678 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:57.287468 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:57.295441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:57.296124 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:57.297290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:57.297896 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:57.443962 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:57.453044 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:57.454971 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:57.456168 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-305d43b1-4e76-463b-bea9-3719e271d46f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.175294 May 18 17:13:57.457340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 359/731] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:57 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:57.612032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-f6aade39-faa4-430f-a364-39d85c234d9f req-bbe2e9f4-fcce-404e-a6be-0bcefd88af24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53e5299-6ac2-4849-a4c1-01924709ff00", "name": "network-vif-plugged", "status": "completed", "tag": "47bc87df-78ea-4da7-8fdc-bd2bd4b75078"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:57.617824 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:57.618499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:57.625949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f6aade39-faa4-430f-a364-39d85c234d9f req-bbe2e9f4-fcce-404e-a6be-0bcefd88af24 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:57.626393 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f6aade39-faa4-430f-a364-39d85c234d9f req-bbe2e9f4-fcce-404e-a6be-0bcefd88af24 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:57.638074 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-f6aade39-faa4-430f-a364-39d85c234d9f req-bbe2e9f4-fcce-404e-a6be-0bcefd88af24 service nova] Creating event network-vif-plugged:47bc87df-78ea-4da7-8fdc-bd2bd4b75078 for instance f53e5299-6ac2-4849-a4c1-01924709ff00 on hv-cinder-79578 May 18 17:13:57.642920 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-f6aade39-faa4-430f-a364-39d85c234d9f req-bbe2e9f4-fcce-404e-a6be-0bcefd88af24 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034641 May 18 17:13:57.643520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 373/732] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:13:57.854231 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:57.854943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:57.856893 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:13:57.862796 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:57.863307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:57.864808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:57.865428 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:57.880239 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] HTTP exception thrown: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Request method failure captured: May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 HTTP/1.1 May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd-EChBzKkiz01fh5jHwWcg3De8TtR_bwgFKRgJ9jgnRpCvL8vCsldgI7ECTbC6s4SzKdtu89TTMMCZ3geYGDCDJXt-0drUJhR5xipkMvIh0RrfwWJk9aLM_732FJdhVaQVwxp539hbVKjP4wuHLVKT1RlOXHRo0dyIpk2JVwHam-Q May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 2ffb442f11714159af838b0176f885ca May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:13:57.882297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2ffb442f11714159af838b0176f885ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2ffb442f11714159af838b0176f885ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeTestJSON-318183275 May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 2ffb442f11714159af838b0176f885ca May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeTestJSON-318183275-project May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 9b596d7285294117b826f459a39872c1 May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeTestJSON-318183275-project May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:13:57.883912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '457f8f5f-ff7d-4484-8e29-298c7ecbee76'} May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:13:57.884795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:13:57.886211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:13:57.887391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Returning 404 to user: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:13:57.887391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6c95298a-703c-4d42-884a-7e4c6db70ea6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 404 len: 111 microversion: 2.1 time: 0.033397 May 18 17:13:57.887679 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 360/733] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:13:57 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:13:57.893019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-319fc9b1-dee0-41d5-b377-dea8b09b113a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '.version_select at 0x7feef3b5c430>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:57.910374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-319fc9b1-dee0-41d5-b377-dea8b09b113a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-93537827" status: 202 len: 0 microversion: 2.1 time: 0.021395 May 18 17:13:57.911835 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 374/734] 10.222.0.49 () {58 vars in 1214 bytes} [Wed May 18 17:13:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-93537827 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:13:58.476086 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:58.476727 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:58.483955 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:58.484411 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:58.485188 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:58.485633 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:58.561324 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-936af7e8-4392-4bf4-905c-984d1496e2f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'create', calling method: .version_select at 0x7feef3a689d0>, body: {"keypair": {"name": "tempest-keypair-662542631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaXxCUtcXlvNaeMZFrO/9ry44Y7Fzr0yNjG5e0uKcFXxOvbEWNhV4CNFA2ojZi9ADFCcRnY2BDpsaJIKWhp5puFiZ+EbkB8w/stMfe9EOfrEXAUIGjWgh7h4jypde1rPQ=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:13:58.576304 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-936af7e8-4392-4bf4-905c-984d1496e2f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Getting quotas for project 2ffb442f11714159af838b0176f885ca. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:13:58.580489 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-936af7e8-4392-4bf4-905c-984d1496e2f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Getting quotas for user 9b596d7285294117b826f459a39872c1 and project 2ffb442f11714159af838b0176f885ca. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:13:58.606495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-936af7e8-4392-4bf4-905c-984d1496e2f1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048980 May 18 17:13:58.607366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 375/735] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:13:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:13:58.643425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:58.653199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:58.655016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:58.656150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-041875e6-1297-4c43-aace-aa8fa7075082 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.185683 May 18 17:13:58.667041 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 361/736] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:58 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:13:59.674699 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:13:59.675607 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:13:59.683680 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:59.684133 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:59.684910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:13:59.685352 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:13:59.931541 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:59.939584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:59.941094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:13:59.942290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-efb572bd-7573-4800-bffd-81ece2fc3459 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1406 microversion: 2.20 time: 0.271810 May 18 17:13:59.942853 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 376/737] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:13:59 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:14:00.068795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-755883165", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4ff4b25c-cd6f-470d-aceb-0e6e57ec0656"}], "security_groups": [{"name": "tempest-securitygroup--512959221"}], "key_name": "tempest-keypair-662542631", "user_data": "}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:00.169518 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] validate_networks() for [('4ff4b25c-cd6f-470d-aceb-0e6e57ec0656', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:14:00.798084 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:14:00.798519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:14:00.799001 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:14:00.799412 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:14:00.799850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:14:00.809041 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:00.809500 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:00.810340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:00.810780 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:00.827793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Getting quotas for project 2ffb442f11714159af838b0176f885ca. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:14:00.831763 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Getting quotas for user 9b596d7285294117b826f459a39872c1 and project 2ffb442f11714159af838b0176f885ca. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:14:00.844217 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:14:00.846528 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:14:00.893270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fad652b0-dffa-41de-ae91-5647708bd8c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.828602 May 18 17:14:00.894261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 362/738] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:14:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:14:00.906535 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-67c181e1-8f3b-46cc-9301-949ac18c7f7c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:00.907191 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-67c181e1-8f3b-46cc-9301-949ac18c7f7c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:00.962695 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:00.963515 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:00.970956 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:00.972449 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:00.973754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:00.974275 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:00.978897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-67c181e1-8f3b-46cc-9301-949ac18c7f7c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:00.988155 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-67c181e1-8f3b-46cc-9301-949ac18c7f7c tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1236 microversion: 2.1 time: 0.085333 May 18 17:14:00.989139 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 377/739] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:00 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:01.123640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:01.133917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:01.135649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:01.141237 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-04d462a1-3d33-49c7-a6c9-7a928e890229 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1598 microversion: 2.20 time: 0.184653 May 18 17:14:01.141941 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 363/740] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:14:00 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1598 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:14:01.159418 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-64d34f7d-8939-435e-a5e3-2dcdddf59e8f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:01.159919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-64d34f7d-8939-435e-a5e3-2dcdddf59e8f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:01.166698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64d34f7d-8939-435e-a5e3-2dcdddf59e8f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:01.167154 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64d34f7d-8939-435e-a5e3-2dcdddf59e8f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:01.167933 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64d34f7d-8939-435e-a5e3-2dcdddf59e8f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:01.168368 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64d34f7d-8939-435e-a5e3-2dcdddf59e8f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:01.256050 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-64d34f7d-8939-435e-a5e3-2dcdddf59e8f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100221 May 18 17:14:01.256739 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 378/741] 10.222.0.49 () {60 vars in 1315 bytes} [Wed May 18 17:14:01 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:14:02.006302 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fa9bed1b-88cc-4c6a-8ae7-57ec0bdc2e33 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:02.006923 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fa9bed1b-88cc-4c6a-8ae7-57ec0bdc2e33 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:02.014053 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa9bed1b-88cc-4c6a-8ae7-57ec0bdc2e33 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:02.014739 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa9bed1b-88cc-4c6a-8ae7-57ec0bdc2e33 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:02.015688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa9bed1b-88cc-4c6a-8ae7-57ec0bdc2e33 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:02.016290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fa9bed1b-88cc-4c6a-8ae7-57ec0bdc2e33 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:02.175783 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fa9bed1b-88cc-4c6a-8ae7-57ec0bdc2e33 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:02.184217 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fa9bed1b-88cc-4c6a-8ae7-57ec0bdc2e33 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1306 microversion: 2.1 time: 0.182409 May 18 17:14:02.184800 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 364/742] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:02 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1306 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:14:02.460492 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-371921c0-57f8-4b31-bc70-d2edcf783664 req-a3989b82-6b00-4d37-ad5c-519c3444dfe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f53e5299-6ac2-4849-a4c1-01924709ff00", "tag": "47bc87df-78ea-4da7-8fdc-bd2bd4b75078"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:02.469935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-371921c0-57f8-4b31-bc70-d2edcf783664 req-a3989b82-6b00-4d37-ad5c-519c3444dfe3 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:02.470632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-371921c0-57f8-4b31-bc70-d2edcf783664 req-a3989b82-6b00-4d37-ad5c-519c3444dfe3 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:02.483146 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-371921c0-57f8-4b31-bc70-d2edcf783664 req-a3989b82-6b00-4d37-ad5c-519c3444dfe3 service nova] Creating event network-changed:47bc87df-78ea-4da7-8fdc-bd2bd4b75078 for instance f53e5299-6ac2-4849-a4c1-01924709ff00 on hv-cinder-79578 May 18 17:14:02.489914 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-371921c0-57f8-4b31-bc70-d2edcf783664 req-a3989b82-6b00-4d37-ad5c-519c3444dfe3 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032972 May 18 17:14:02.490532 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 379/743] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:14:03.203694 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0ee6dc42-c008-4b84-b493-f8cd8bb0fc95 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:03.204908 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0ee6dc42-c008-4b84-b493-f8cd8bb0fc95 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:03.218411 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0ee6dc42-c008-4b84-b493-f8cd8bb0fc95 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:03.222262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0ee6dc42-c008-4b84-b493-f8cd8bb0fc95 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:03.224641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0ee6dc42-c008-4b84-b493-f8cd8bb0fc95 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:03.225368 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0ee6dc42-c008-4b84-b493-f8cd8bb0fc95 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:03.230476 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:03.456209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0ee6dc42-c008-4b84-b493-f8cd8bb0fc95 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:03.465528 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0ee6dc42-c008-4b84-b493-f8cd8bb0fc95 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1361 microversion: 2.1 time: 0.266752 May 18 17:14:03.466527 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 365/744] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:03 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:04.485177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-613b88c7-8e0c-432c-826a-d7c53b5fd94d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:04.485971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-613b88c7-8e0c-432c-826a-d7c53b5fd94d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:04.492761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-613b88c7-8e0c-432c-826a-d7c53b5fd94d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:04.493206 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-613b88c7-8e0c-432c-826a-d7c53b5fd94d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:04.493985 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-613b88c7-8e0c-432c-826a-d7c53b5fd94d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:04.494413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-613b88c7-8e0c-432c-826a-d7c53b5fd94d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:04.507240 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-3f92d65b-9c14-4514-b0be-ebc8265278d4 req-b02262f2-0e3c-4118-b46a-8ccc954063b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477c2c87-8a2c-4acf-ba33-221f1ac3b4d6", "tag": "d73ff1bd-c125-4c71-88a9-127b38c3ce37"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:04.515945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-3f92d65b-9c14-4514-b0be-ebc8265278d4 req-b02262f2-0e3c-4118-b46a-8ccc954063b8 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:04.516379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-3f92d65b-9c14-4514-b0be-ebc8265278d4 req-b02262f2-0e3c-4118-b46a-8ccc954063b8 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:04.527992 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-3f92d65b-9c14-4514-b0be-ebc8265278d4 req-b02262f2-0e3c-4118-b46a-8ccc954063b8 service nova] Creating event network-changed:d73ff1bd-c125-4c71-88a9-127b38c3ce37 for instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 on hv-cinder-79578 May 18 17:14:04.533009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-3f92d65b-9c14-4514-b0be-ebc8265278d4 req-b02262f2-0e3c-4118-b46a-8ccc954063b8 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030100 May 18 17:14:04.533596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 366/745] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:14:04.629066 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-613b88c7-8e0c-432c-826a-d7c53b5fd94d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:04.639717 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-613b88c7-8e0c-432c-826a-d7c53b5fd94d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1361 microversion: 2.1 time: 0.159214 May 18 17:14:04.640288 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 380/746] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:04 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:05.657558 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d1ef560c-b9d1-4708-84c3-23159df522f8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:05.658292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d1ef560c-b9d1-4708-84c3-23159df522f8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:05.664545 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d1ef560c-b9d1-4708-84c3-23159df522f8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:05.664988 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d1ef560c-b9d1-4708-84c3-23159df522f8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:05.665799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d1ef560c-b9d1-4708-84c3-23159df522f8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:05.666229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d1ef560c-b9d1-4708-84c3-23159df522f8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:05.822218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d1ef560c-b9d1-4708-84c3-23159df522f8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:05.830089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d1ef560c-b9d1-4708-84c3-23159df522f8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1361 microversion: 2.1 time: 0.177299 May 18 17:14:05.830657 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 367/747] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:05 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:06.848609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b98c914b-32e6-4ef7-836e-85f2f764272d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:06.849334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b98c914b-32e6-4ef7-836e-85f2f764272d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:06.856128 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b98c914b-32e6-4ef7-836e-85f2f764272d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:06.856573 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b98c914b-32e6-4ef7-836e-85f2f764272d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:06.857341 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b98c914b-32e6-4ef7-836e-85f2f764272d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:06.857796 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b98c914b-32e6-4ef7-836e-85f2f764272d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:06.862094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:07.007115 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b98c914b-32e6-4ef7-836e-85f2f764272d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:07.015477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b98c914b-32e6-4ef7-836e-85f2f764272d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1361 microversion: 2.1 time: 0.171544 May 18 17:14:07.016047 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 381/748] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:06 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:08.032436 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ce0da91a-1487-4484-a283-ff35e67b90cb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:08.033183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ce0da91a-1487-4484-a283-ff35e67b90cb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:08.040767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ce0da91a-1487-4484-a283-ff35e67b90cb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:08.041300 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ce0da91a-1487-4484-a283-ff35e67b90cb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:08.042105 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ce0da91a-1487-4484-a283-ff35e67b90cb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:08.042543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ce0da91a-1487-4484-a283-ff35e67b90cb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:08.254263 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ce0da91a-1487-4484-a283-ff35e67b90cb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:08.263224 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ce0da91a-1487-4484-a283-ff35e67b90cb tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1361 microversion: 2.1 time: 0.234606 May 18 17:14:08.273023 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 368/749] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:08 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:09.280415 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1b1d5efb-183c-442f-a41b-cec45f4bb254 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:09.280954 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1b1d5efb-183c-442f-a41b-cec45f4bb254 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:09.287576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1b1d5efb-183c-442f-a41b-cec45f4bb254 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:09.288020 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1b1d5efb-183c-442f-a41b-cec45f4bb254 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:09.288780 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1b1d5efb-183c-442f-a41b-cec45f4bb254 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:09.289209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1b1d5efb-183c-442f-a41b-cec45f4bb254 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:09.428573 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1b1d5efb-183c-442f-a41b-cec45f4bb254 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:09.436483 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1b1d5efb-183c-442f-a41b-cec45f4bb254 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1361 microversion: 2.1 time: 0.159702 May 18 17:14:09.436756 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 382/750] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:09 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:09.749369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-0f14d9a4-2633-4e9a-894f-edc5b7b595c9 req-44d84538-e36f-4a1d-a58a-c1839056cbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477c2c87-8a2c-4acf-ba33-221f1ac3b4d6", "name": "network-vif-plugged", "status": "completed", "tag": "d73ff1bd-c125-4c71-88a9-127b38c3ce37"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:09.758605 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-0f14d9a4-2633-4e9a-894f-edc5b7b595c9 req-44d84538-e36f-4a1d-a58a-c1839056cbbb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:09.759050 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-0f14d9a4-2633-4e9a-894f-edc5b7b595c9 req-44d84538-e36f-4a1d-a58a-c1839056cbbb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:09.771988 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-0f14d9a4-2633-4e9a-894f-edc5b7b595c9 req-44d84538-e36f-4a1d-a58a-c1839056cbbb service nova] Creating event network-vif-plugged:d73ff1bd-c125-4c71-88a9-127b38c3ce37 for instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 on hv-cinder-79578 May 18 17:14:09.777056 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-0f14d9a4-2633-4e9a-894f-edc5b7b595c9 req-44d84538-e36f-4a1d-a58a-c1839056cbbb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031299 May 18 17:14:09.777957 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 369/751] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:14:10.453763 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5f653375-2866-4dc4-a569-b3486aec4f7a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:10.454384 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5f653375-2866-4dc4-a569-b3486aec4f7a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:10.461088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f653375-2866-4dc4-a569-b3486aec4f7a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:10.461537 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f653375-2866-4dc4-a569-b3486aec4f7a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:10.462396 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f653375-2866-4dc4-a569-b3486aec4f7a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:10.462836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5f653375-2866-4dc4-a569-b3486aec4f7a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:10.591935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5f653375-2866-4dc4-a569-b3486aec4f7a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:10.599550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5f653375-2866-4dc4-a569-b3486aec4f7a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1361 microversion: 2.1 time: 0.149580 May 18 17:14:10.600186 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 383/752] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:10 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:11.614303 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:11.615194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:11.619793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1021f66c-1a76-4cf1-9ddd-3633e464eb0d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:11.620509 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1021f66c-1a76-4cf1-9ddd-3633e464eb0d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:11.628227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1021f66c-1a76-4cf1-9ddd-3633e464eb0d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:11.628675 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1021f66c-1a76-4cf1-9ddd-3633e464eb0d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:11.630021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1021f66c-1a76-4cf1-9ddd-3633e464eb0d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:11.630461 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1021f66c-1a76-4cf1-9ddd-3633e464eb0d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:12.151009 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1021f66c-1a76-4cf1-9ddd-3633e464eb0d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:12.158548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1021f66c-1a76-4cf1-9ddd-3633e464eb0d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1361 microversion: 2.1 time: 0.545764 May 18 17:14:12.159130 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 370/753] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:11 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1361 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:13.178280 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d4cb5d87-8f8f-4f7b-9cee-ff077175297d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:13.179714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d4cb5d87-8f8f-4f7b-9cee-ff077175297d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:13.183307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:13.188569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4cb5d87-8f8f-4f7b-9cee-ff077175297d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:13.189024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4cb5d87-8f8f-4f7b-9cee-ff077175297d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:13.190024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4cb5d87-8f8f-4f7b-9cee-ff077175297d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:13.190469 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4cb5d87-8f8f-4f7b-9cee-ff077175297d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:13.347455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d4cb5d87-8f8f-4f7b-9cee-ff077175297d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:13.355556 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d4cb5d87-8f8f-4f7b-9cee-ff077175297d tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1547 microversion: 2.1 time: 0.181947 May 18 17:14:13.356117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 384/754] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:13 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1547 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:13.373672 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0d4cd76a-dbb5-4e7c-b1ae-bea3628d75e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:13.374175 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0d4cd76a-dbb5-4e7c-b1ae-bea3628d75e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:13.381111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0d4cd76a-dbb5-4e7c-b1ae-bea3628d75e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:13.381572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0d4cd76a-dbb5-4e7c-b1ae-bea3628d75e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:13.382393 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0d4cd76a-dbb5-4e7c-b1ae-bea3628d75e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:13.382839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0d4cd76a-dbb5-4e7c-b1ae-bea3628d75e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:13.463996 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0d4cd76a-dbb5-4e7c-b1ae-bea3628d75e7 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094073 May 18 17:14:13.464596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 371/755] 10.222.0.49 () {58 vars in 1274 bytes} [Wed May 18 17:14:13 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:14:14.470135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-8d2ff731-2e15-4109-963b-6b28d70193ec req-e3163051-aca4-4e22-aec9-86814d20cb30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "477c2c87-8a2c-4acf-ba33-221f1ac3b4d6", "tag": "d73ff1bd-c125-4c71-88a9-127b38c3ce37"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:14.480572 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-8d2ff731-2e15-4109-963b-6b28d70193ec req-e3163051-aca4-4e22-aec9-86814d20cb30 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:14.481152 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-8d2ff731-2e15-4109-963b-6b28d70193ec req-e3163051-aca4-4e22-aec9-86814d20cb30 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:14.494877 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-8d2ff731-2e15-4109-963b-6b28d70193ec req-e3163051-aca4-4e22-aec9-86814d20cb30 service nova] Creating event network-changed:d73ff1bd-c125-4c71-88a9-127b38c3ce37 for instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 on hv-cinder-79578 May 18 17:14:14.500570 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-8d2ff731-2e15-4109-963b-6b28d70193ec req-e3163051-aca4-4e22-aec9-86814d20cb30 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034673 May 18 17:14:14.501996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 385/756] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:14:18.226887 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-14b9f0d9-2681-4159-b15b-d27894adc801 req-02c139fb-a021-465c-b2d4-a5cf2d1775b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee", "tag": "cac676f2-4e76-4013-9947-99f06f080ac2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:18.227505 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ed83617a-93fa-43ad-88b5-dcda8bd9647d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:18.227505 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ed83617a-93fa-43ad-88b5-dcda8bd9647d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:18.233993 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed83617a-93fa-43ad-88b5-dcda8bd9647d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:18.234435 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed83617a-93fa-43ad-88b5-dcda8bd9647d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:18.235224 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed83617a-93fa-43ad-88b5-dcda8bd9647d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:18.235665 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed83617a-93fa-43ad-88b5-dcda8bd9647d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:18.236495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-14b9f0d9-2681-4159-b15b-d27894adc801 req-02c139fb-a021-465c-b2d4-a5cf2d1775b9 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:18.237073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-14b9f0d9-2681-4159-b15b-d27894adc801 req-02c139fb-a021-465c-b2d4-a5cf2d1775b9 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:18.259558 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-14b9f0d9-2681-4159-b15b-d27894adc801 req-02c139fb-a021-465c-b2d4-a5cf2d1775b9 service nova] Creating event network-changed:cac676f2-4e76-4013-9947-99f06f080ac2 for instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee on hv-cinder-79578 May 18 17:14:18.265454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-14b9f0d9-2681-4159-b15b-d27894adc801 req-02c139fb-a021-465c-b2d4-a5cf2d1775b9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044853 May 18 17:14:18.267753 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ed83617a-93fa-43ad-88b5-dcda8bd9647d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:14:18.269143 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 372/757] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:14:18.353726 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ed83617a-93fa-43ad-88b5-dcda8bd9647d tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "DELETE /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 204 len: 0 microversion: 2.1 time: 0.133280 May 18 17:14:18.354460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 386/758] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:14:18 2022] DELETE /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:14:18.365301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b88aee87-1870-4706-9cf9-e79d5a8febce tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:18.366029 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b88aee87-1870-4706-9cf9-e79d5a8febce tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:18.372720 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b88aee87-1870-4706-9cf9-e79d5a8febce tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:18.373166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b88aee87-1870-4706-9cf9-e79d5a8febce tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:18.373996 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b88aee87-1870-4706-9cf9-e79d5a8febce tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:18.374441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b88aee87-1870-4706-9cf9-e79d5a8febce tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:18.523462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b88aee87-1870-4706-9cf9-e79d5a8febce tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:18.532998 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b88aee87-1870-4706-9cf9-e79d5a8febce tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.173326 May 18 17:14:18.533588 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 373/759] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:18 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:14:19.553346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-33d81af5-c4d3-4cbc-91cc-712036597b96 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:19.554332 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-33d81af5-c4d3-4cbc-91cc-712036597b96 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:19.563654 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-33d81af5-c4d3-4cbc-91cc-712036597b96 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:19.564176 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-33d81af5-c4d3-4cbc-91cc-712036597b96 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:19.565127 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-33d81af5-c4d3-4cbc-91cc-712036597b96 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:19.565972 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-33d81af5-c4d3-4cbc-91cc-712036597b96 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:19.720698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-33d81af5-c4d3-4cbc-91cc-712036597b96 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:19.729049 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-33d81af5-c4d3-4cbc-91cc-712036597b96 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.180492 May 18 17:14:19.729632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 387/760] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:19 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:20.746304 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-980a9922-ef60-421f-a47c-e7dff239dc23 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:20.746958 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-980a9922-ef60-421f-a47c-e7dff239dc23 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:20.753526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-980a9922-ef60-421f-a47c-e7dff239dc23 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:20.754166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-980a9922-ef60-421f-a47c-e7dff239dc23 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:20.754955 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-980a9922-ef60-421f-a47c-e7dff239dc23 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:20.755405 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-980a9922-ef60-421f-a47c-e7dff239dc23 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:20.905844 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-980a9922-ef60-421f-a47c-e7dff239dc23 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:20.914225 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-980a9922-ef60-421f-a47c-e7dff239dc23 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.171750 May 18 17:14:20.914793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 374/761] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:20 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:21.932177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3bbb5d9f-d691-4609-84a7-d18166cb8e21 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:21.932782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3bbb5d9f-d691-4609-84a7-d18166cb8e21 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:21.939202 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bbb5d9f-d691-4609-84a7-d18166cb8e21 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:21.939641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bbb5d9f-d691-4609-84a7-d18166cb8e21 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:21.940401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bbb5d9f-d691-4609-84a7-d18166cb8e21 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:21.940830 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bbb5d9f-d691-4609-84a7-d18166cb8e21 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:22.074774 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3bbb5d9f-d691-4609-84a7-d18166cb8e21 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:22.082952 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3bbb5d9f-d691-4609-84a7-d18166cb8e21 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.153982 May 18 17:14:22.083684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 388/762] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:21 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:23.104664 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-573e1256-05d1-403b-9869-79a011d1c13e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:23.105851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-573e1256-05d1-403b-9869-79a011d1c13e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:23.110847 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:23.122405 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-573e1256-05d1-403b-9869-79a011d1c13e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:23.122873 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-573e1256-05d1-403b-9869-79a011d1c13e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:23.123664 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-573e1256-05d1-403b-9869-79a011d1c13e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:23.124102 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-573e1256-05d1-403b-9869-79a011d1c13e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:23.348183 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-573e1256-05d1-403b-9869-79a011d1c13e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:23.355935 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-573e1256-05d1-403b-9869-79a011d1c13e tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1567 microversion: 2.1 time: 0.259291 May 18 17:14:23.356514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 375/763] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:23 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:24.373484 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dc3eefbd-5200-4c56-9b50-aedde4793b97 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:24.374056 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dc3eefbd-5200-4c56-9b50-aedde4793b97 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:24.376612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:24.381999 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc3eefbd-5200-4c56-9b50-aedde4793b97 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:24.382440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc3eefbd-5200-4c56-9b50-aedde4793b97 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:24.383194 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc3eefbd-5200-4c56-9b50-aedde4793b97 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:24.383622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dc3eefbd-5200-4c56-9b50-aedde4793b97 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:24.522693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dc3eefbd-5200-4c56-9b50-aedde4793b97 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:24.531328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dc3eefbd-5200-4c56-9b50-aedde4793b97 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1449 microversion: 2.1 time: 0.161687 May 18 17:14:24.531894 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 389/764] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:24 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1449 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:24.980789 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-175951f5-27f5-43cf-a30a-9ed9ad872a8b req-aa1b8bf3-1fef-4161-80ed-5f4607b4235b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee", "name": "network-vif-deleted", "tag": "cac676f2-4e76-4013-9947-99f06f080ac2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:24.991481 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-175951f5-27f5-43cf-a30a-9ed9ad872a8b req-aa1b8bf3-1fef-4161-80ed-5f4607b4235b service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:24.991924 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-175951f5-27f5-43cf-a30a-9ed9ad872a8b req-aa1b8bf3-1fef-4161-80ed-5f4607b4235b service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:25.004162 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-175951f5-27f5-43cf-a30a-9ed9ad872a8b req-aa1b8bf3-1fef-4161-80ed-5f4607b4235b service nova] Creating event network-vif-deleted:cac676f2-4e76-4013-9947-99f06f080ac2 for instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee on hv-cinder-79578 May 18 17:14:25.009689 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-175951f5-27f5-43cf-a30a-9ed9ad872a8b req-aa1b8bf3-1fef-4161-80ed-5f4607b4235b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032691 May 18 17:14:25.010299 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 376/765] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:14:25.549025 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:25.549785 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:25.557045 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:25.557494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:25.558291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:25.558720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:25.592174 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:25.592648 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:25.593334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lazy-loading 'fault' on Instance uuid d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:14:25.643656 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edf6a4f02eb34720b0126d17db1c1b86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10568aeb4aba423585e0668a4a5e05d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:25.651788 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6436f26e-7b73-4ae5-b572-1e99d734871a tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 200 len: 1223 microversion: 2.1 time: 0.106663 May 18 17:14:25.652377 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 390/766] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:25 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 1223 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:26.670573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:26.671259 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] [instance: d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:26.677520 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:26.677998 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:26.678775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:26.679205 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:26.694492 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] HTTP exception thrown: Instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee could not be found. May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Request method failure captured: May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee HTTP/1.1 May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSfaiJm0PKWOIbNh5WcXtKjoU85NSxttn4bzx3C1-ht-kQ5_6a9hzM87YerutHbyGOJasOKZa8CJtxJd-46BmTSle6tsQlLmiJEpTefzJrWaSYkyALYoVC1D4baXjhE7A6_21u8po0ZUyVn-U4uvz8giTWyHZEiRRzoGfIwd_UzISBM May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 10568aeb4aba423585e0668a4a5e05d9 May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-TestShelveInstance-1691403940 May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:14:26.696129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10568aeb4aba423585e0668a4a5e05d9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_10568aeb4aba423585e0668a4a5e05d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/10568aeb4aba423585e0668a4a5e05d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/10568aeb4aba423585e0668a4a5e05d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-TestShelveInstance-1691403940 May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 10568aeb4aba423585e0668a4a5e05d9 May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-TestShelveInstance-1691403940 May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-TestShelveInstance-1691403940-project May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: edf6a4f02eb34720b0126d17db1c1b86 May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-TestShelveInstance-1691403940-project May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee could not be found. May 18 17:14:26.698356 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'd7a52ec4-3dd4-4afb-a2d4-84385cf3cdee'} May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee could not be found. May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:14:26.699441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee could not be found. May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee could not be found. May 18 17:14:26.700737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:26.702841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Returning 404 to user: Instance d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:14:26.702841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7c0291e6-b35a-4ad8-8764-1954420526bd tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee" status: 404 len: 111 microversion: 2.1 time: 0.031566 May 18 17:14:26.702841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 377/767] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:26 2022] GET /compute/v2.1/servers/d7a52ec4-3dd4-4afb-a2d4-84385cf3cdee => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:14:26.907209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1dc915da-01f5-4a96-8bd4-5bf8ab3ea9c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] Calling method '.version_select at 0x7feef3b5ca60>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:26.927738 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1dc915da-01f5-4a96-8bd4-5bf8ab3ea9c7 tempest-TestShelveInstance-1691403940 tempest-TestShelveInstance-1691403940-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-623668497" status: 202 len: 0 microversion: 2.1 time: 0.024586 May 18 17:14:26.928171 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 391/768] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:14:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-623668497 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 17:14:45.598091 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cb82974a-f16e-410a-9ed8-44b2c021d6e2 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:45.599496 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cb82974a-f16e-410a-9ed8-44b2c021d6e2 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:45.602409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=5 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:45.603140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=54 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:45.610375 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb82974a-f16e-410a-9ed8-44b2c021d6e2 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:45.610824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb82974a-f16e-410a-9ed8-44b2c021d6e2 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:45.611618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb82974a-f16e-410a-9ed8-44b2c021d6e2 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:45.612055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb82974a-f16e-410a-9ed8-44b2c021d6e2 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:45.637766 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cb82974a-f16e-410a-9ed8-44b2c021d6e2 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/ips" status: 200 len: 148 microversion: 2.1 time: 0.043464 May 18 17:14:45.638335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 378/769] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:14:45 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:14:48.016508 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2db7efa7-b0a3-4bff-b74a-3a56d52dd2a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:48.017576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2db7efa7-b0a3-4bff-b74a-3a56d52dd2a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:48.019714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:48.020367 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=8,nova_api:DELETE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:48.028133 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2db7efa7-b0a3-4bff-b74a-3a56d52dd2a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:48.028584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2db7efa7-b0a3-4bff-b74a-3a56d52dd2a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:48.029388 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2db7efa7-b0a3-4bff-b74a-3a56d52dd2a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:48.029885 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2db7efa7-b0a3-4bff-b74a-3a56d52dd2a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:48.318805 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2db7efa7-b0a3-4bff-b74a-3a56d52dd2a8 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306134 May 18 17:14:48.319430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 392/770] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:14:48 2022] POST /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:14:56.915907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:14:56.917003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:56.919015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:56.919658 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:14:56.926777 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:56.927231 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:56.928014 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:56.928453 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:57.009128 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Invalid volume: volume 49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa is already attached to instances: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: POST /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments HTTP/1.1 May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 74 May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:14:57.010718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {"volumeAttachment": {"volumeId": "49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa"}} May 18 17:14:57.012250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Invalid volume: volume 49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa is already attached to instances: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'server_id': '8dc5c540-cca9-45b1-8f26-a3a7e20726fc', 'body': {'volumeAttachment': {'volumeId': '49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa'}}} May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa is already attached to instances: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:57.012995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa is already attached to instances: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:14:57.014222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:14:57.015427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:14:57.015427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:14:57.015427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:14:57.015427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa is already attached to instances: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc May 18 17:14:57.015427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:14:57.015427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 400 to user: Invalid volume: volume 49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa is already attached to instances: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:14:57.015427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4dac1f36-8e69-401f-ba3a-ef243fd70b40 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100560 May 18 17:14:57.015427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 379/771] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:14:56 2022] POST /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 18 17:14:57.074720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f5ad0468-5899-4469-925e-4349844dcc39 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:57.075296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f5ad0468-5899-4469-925e-4349844dcc39 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:57.082281 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f5ad0468-5899-4469-925e-4349844dcc39 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:57.082729 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f5ad0468-5899-4469-925e-4349844dcc39 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:57.083489 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f5ad0468-5899-4469-925e-4349844dcc39 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:57.083922 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f5ad0468-5899-4469-925e-4349844dcc39 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:57.163745 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-f5ad0468-5899-4469-925e-4349844dcc39 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lazy-loading 'services' on Instance uuid 8dc5c540-cca9-45b1-8f26-a3a7e20726fc {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:14:57.240866 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f5ad0468-5899-4469-925e-4349844dcc39 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments/49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa" status: 202 len: 0 microversion: 2.1 time: 0.170189 May 18 17:14:57.241470 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 393/772] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:14:57 2022] DELETE /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments/49b0c4fa-3996-4a4f-857b-ccf9a6c4bcaa => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:14:57.250083 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1f19c725-8cde-4d87-a709-cf31e45c3c33 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:57.251046 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1f19c725-8cde-4d87-a709-cf31e45c3c33 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:57.258557 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f19c725-8cde-4d87-a709-cf31e45c3c33 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:57.259138 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f19c725-8cde-4d87-a709-cf31e45c3c33 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:57.259774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f19c725-8cde-4d87-a709-cf31e45c3c33 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:57.260294 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f19c725-8cde-4d87-a709-cf31e45c3c33 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:57.295893 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1f19c725-8cde-4d87-a709-cf31e45c3c33 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049881 May 18 17:14:57.296758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 380/773] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:14:57 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:14:58.308984 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c5b04567-ef55-4166-8024-09c69d5f9ea7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:58.310081 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c5b04567-ef55-4166-8024-09c69d5f9ea7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:58.317353 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c5b04567-ef55-4166-8024-09c69d5f9ea7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:58.317842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c5b04567-ef55-4166-8024-09c69d5f9ea7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:58.319208 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c5b04567-ef55-4166-8024-09c69d5f9ea7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:58.319208 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c5b04567-ef55-4166-8024-09c69d5f9ea7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:58.351534 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c5b04567-ef55-4166-8024-09c69d5f9ea7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046758 May 18 17:14:58.352329 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 394/774] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:14:58 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 17:14:58.412201 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-edbb992f-2def-4491-a86d-9dc7675cde73 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:58.412805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-edbb992f-2def-4491-a86d-9dc7675cde73 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:58.419675 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-edbb992f-2def-4491-a86d-9dc7675cde73 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:58.420200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-edbb992f-2def-4491-a86d-9dc7675cde73 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:58.421039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-edbb992f-2def-4491-a86d-9dc7675cde73 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:58.421565 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-edbb992f-2def-4491-a86d-9dc7675cde73 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:58.447724 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-edbb992f-2def-4491-a86d-9dc7675cde73 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:14:58.531673 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-edbb992f-2def-4491-a86d-9dc7675cde73 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 204 len: 0 microversion: 2.1 time: 0.122942 May 18 17:14:58.532678 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 381/775] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:14:58 2022] DELETE /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:14:58.541318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d58c8bab-2a24-42bd-9b02-10ba4be1da5d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:58.541960 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d58c8bab-2a24-42bd-9b02-10ba4be1da5d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:58.548751 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d58c8bab-2a24-42bd-9b02-10ba4be1da5d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:58.549206 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d58c8bab-2a24-42bd-9b02-10ba4be1da5d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:58.550015 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d58c8bab-2a24-42bd-9b02-10ba4be1da5d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:58.550671 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d58c8bab-2a24-42bd-9b02-10ba4be1da5d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:58.705424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d58c8bab-2a24-42bd-9b02-10ba4be1da5d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:58.713579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d58c8bab-2a24-42bd-9b02-10ba4be1da5d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1680 microversion: 2.1 time: 0.176177 May 18 17:14:58.714207 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 395/776] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:58 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:14:59.731951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-efddf1cb-a8e4-4994-8cef-0caf1e96914b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:14:59.732646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-efddf1cb-a8e4-4994-8cef-0caf1e96914b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:14:59.740047 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efddf1cb-a8e4-4994-8cef-0caf1e96914b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:59.740489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efddf1cb-a8e4-4994-8cef-0caf1e96914b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:59.741334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efddf1cb-a8e4-4994-8cef-0caf1e96914b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:14:59.741824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efddf1cb-a8e4-4994-8cef-0caf1e96914b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:14:59.889940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-efddf1cb-a8e4-4994-8cef-0caf1e96914b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:14:59.898588 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-efddf1cb-a8e4-4994-8cef-0caf1e96914b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1680 microversion: 2.1 time: 0.170855 May 18 17:14:59.899152 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 382/777] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:14:59 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:00.915970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-06dea6ba-64f9-4f1f-8462-cba457397dea tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:00.916597 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-06dea6ba-64f9-4f1f-8462-cba457397dea tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:00.923154 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-06dea6ba-64f9-4f1f-8462-cba457397dea tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:00.923604 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-06dea6ba-64f9-4f1f-8462-cba457397dea tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:00.924435 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-06dea6ba-64f9-4f1f-8462-cba457397dea tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:00.924993 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-06dea6ba-64f9-4f1f-8462-cba457397dea tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:01.060377 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-06dea6ba-64f9-4f1f-8462-cba457397dea tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:01.069460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-06dea6ba-64f9-4f1f-8462-cba457397dea tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1680 microversion: 2.1 time: 0.157022 May 18 17:15:01.069812 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 396/778] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:00 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:15:02.087717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6052dd08-f400-4238-9ea8-f6bd762bb6aa tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:02.088730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6052dd08-f400-4238-9ea8-f6bd762bb6aa tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:02.096289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6052dd08-f400-4238-9ea8-f6bd762bb6aa tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:02.096823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6052dd08-f400-4238-9ea8-f6bd762bb6aa tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:02.097875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6052dd08-f400-4238-9ea8-f6bd762bb6aa tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:02.098317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6052dd08-f400-4238-9ea8-f6bd762bb6aa tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:02.193950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6052dd08-f400-4238-9ea8-f6bd762bb6aa tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:02.201741 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6052dd08-f400-4238-9ea8-f6bd762bb6aa tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 200 len: 1613 microversion: 2.1 time: 0.118545 May 18 17:15:02.202316 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 383/779] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:02 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 1613 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:02.287064 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-e69bb43d-ea5f-4548-9cae-355a17ddd726 req-05fe0604-48fd-44cf-ac12-fc2a5f9cbeaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dc5c540-cca9-45b1-8f26-a3a7e20726fc", "name": "network-vif-deleted", "tag": "b64cd2ca-bae4-4611-99a1-1520fac5e7f4"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:15:02.296952 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e69bb43d-ea5f-4548-9cae-355a17ddd726 req-05fe0604-48fd-44cf-ac12-fc2a5f9cbeaf service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:02.297400 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-e69bb43d-ea5f-4548-9cae-355a17ddd726 req-05fe0604-48fd-44cf-ac12-fc2a5f9cbeaf service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:02.312149 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-e69bb43d-ea5f-4548-9cae-355a17ddd726 req-05fe0604-48fd-44cf-ac12-fc2a5f9cbeaf service nova] Creating event network-vif-deleted:b64cd2ca-bae4-4611-99a1-1520fac5e7f4 for instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc on hv-cinder-79578 May 18 17:15:02.323501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-e69bb43d-ea5f-4548-9cae-355a17ddd726 req-05fe0604-48fd-44cf-ac12-fc2a5f9cbeaf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040537 May 18 17:15:02.324510 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 397/780] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:15:03.219091 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:03.219698 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:03.232454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:03.232903 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:03.233712 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:03.234151 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:03.249839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc HTTP/1.1 May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:15:03.251510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:15:03.253264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '8dc5c540-cca9-45b1-8f26-a3a7e20726fc'} May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:15:03.254035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:15:03.255218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:15:03.256310 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:15:03.256310 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dbda89fd-5dcd-4f1b-8ac5-37702f1d8284 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 404 len: 111 microversion: 2.1 time: 0.038705 May 18 17:15:03.256310 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 384/781] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:03 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:15:03.263319 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1479a7f6-f753-435b-be79-1d4bd5713909 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '.version_select at 0x7feef3cea0d0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:03.281269 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1479a7f6-f753-435b-be79-1d4bd5713909 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853147682" status: 202 len: 0 microversion: 2.1 time: 0.022045 May 18 17:15:03.281908 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 398/782] 10.222.0.49 () {58 vars in 1220 bytes} [Wed May 18 17:15:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1853147682 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:15:03.935556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ac49f71d-af38-4f8c-be1c-60c670d53071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: .version_select at 0x7fef0028df70>, body: {"keypair": {"name": "tempest-keypair-1583919513", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb4BNHNnpS6RQ/l+88r13lUXEnzztt87s2j5k2N1MYXubF+83jvmmb+/ZN3ehUMWsLfAVVVG8jymVwZrNu9GB7VbLbQAsM9qolLWXd4FuMzc5cXpHJiLuK2O311iip8tA=="}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:15:03.949849 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-ac49f71d-af38-4f8c-be1c-60c670d53071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:15:03.953932 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-ac49f71d-af38-4f8c-be1c-60c670d53071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for user 01881ccdf756480b8fcc1ac599fdf905 and project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:15:03.978081 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ac49f71d-af38-4f8c-be1c-60c670d53071 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049603 May 18 17:15:03.978877 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 385/783] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:15:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:15:05.383318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-61647131", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f1747880-dcf4-4125-af66-c635d137ec57"}], "security_groups": [{"name": "tempest-securitygroup--897503402"}], "key_name": "tempest-keypair-1583919513", "user_data": "}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:15:05.492865 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] validate_networks() for [('f1747880-dcf4-4125-af66-c635d137ec57', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:15:05.935119 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:15:05.935843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:15:05.936703 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:15:05.937463 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:15:05.938225 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:15:05.952673 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:05.953359 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:05.954635 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:05.955567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:05.982728 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:15:05.987581 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Getting quotas for user 01881ccdf756480b8fcc1ac599fdf905 and project b0f5daaa505d4985a76f95f1cf7b2da6. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:15:06.005262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:15:06.007941 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:15:06.059064 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1764aee5-fa4d-4790-bab4-7bcdd32f255c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.679890 May 18 17:15:06.059784 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 399/784] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:15:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:15:06.074907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dc355dcc-e263-4866-9e7d-0ebf868e7420 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:06.076099 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dc355dcc-e263-4866-9e7d-0ebf868e7420 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:06.156966 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dc355dcc-e263-4866-9e7d-0ebf868e7420 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:06.165275 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dc355dcc-e263-4866-9e7d-0ebf868e7420 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1240 microversion: 2.1 time: 0.097697 May 18 17:15:06.166011 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 386/785] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:06 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1240 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:07.183935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6531c881-d5ea-47c7-a685-e28af4044875 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:07.184548 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6531c881-d5ea-47c7-a685-e28af4044875 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:07.191855 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6531c881-d5ea-47c7-a685-e28af4044875 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:07.192307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6531c881-d5ea-47c7-a685-e28af4044875 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:07.193086 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6531c881-d5ea-47c7-a685-e28af4044875 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:07.193526 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6531c881-d5ea-47c7-a685-e28af4044875 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:07.259751 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6531c881-d5ea-47c7-a685-e28af4044875 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:07.267360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6531c881-d5ea-47c7-a685-e28af4044875 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1244 microversion: 2.1 time: 0.087779 May 18 17:15:07.267948 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 400/786] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:07 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1244 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:08.285167 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9d5764e6-2d08-4c32-87d4-a3bb38926ab0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:08.285916 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9d5764e6-2d08-4c32-87d4-a3bb38926ab0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:08.293038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d5764e6-2d08-4c32-87d4-a3bb38926ab0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:08.293566 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d5764e6-2d08-4c32-87d4-a3bb38926ab0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:08.294479 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d5764e6-2d08-4c32-87d4-a3bb38926ab0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:08.295004 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d5764e6-2d08-4c32-87d4-a3bb38926ab0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:08.363680 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9d5764e6-2d08-4c32-87d4-a3bb38926ab0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:08.371570 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9d5764e6-2d08-4c32-87d4-a3bb38926ab0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1244 microversion: 2.1 time: 0.091300 May 18 17:15:08.372161 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 387/787] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:08 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1244 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:09.395754 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1fb82b6e-fe51-4b6c-ab19-338fff60643b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:09.396296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1fb82b6e-fe51-4b6c-ab19-338fff60643b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:09.403310 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1fb82b6e-fe51-4b6c-ab19-338fff60643b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:09.403762 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1fb82b6e-fe51-4b6c-ab19-338fff60643b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:09.404545 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1fb82b6e-fe51-4b6c-ab19-338fff60643b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:09.404987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1fb82b6e-fe51-4b6c-ab19-338fff60643b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:09.469590 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1fb82b6e-fe51-4b6c-ab19-338fff60643b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:09.478303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1fb82b6e-fe51-4b6c-ab19-338fff60643b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1236 microversion: 2.1 time: 0.087500 May 18 17:15:09.478892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 401/788] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:09 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:10.496014 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-6fff2a51-681e-4c86-94cd-24d3ae29eb42 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:10.496768 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-6fff2a51-681e-4c86-94cd-24d3ae29eb42 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:10.503685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fff2a51-681e-4c86-94cd-24d3ae29eb42 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:10.504133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fff2a51-681e-4c86-94cd-24d3ae29eb42 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:10.504911 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fff2a51-681e-4c86-94cd-24d3ae29eb42 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:10.505346 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-6fff2a51-681e-4c86-94cd-24d3ae29eb42 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:10.576643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-6fff2a51-681e-4c86-94cd-24d3ae29eb42 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:10.586118 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-6fff2a51-681e-4c86-94cd-24d3ae29eb42 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1292 microversion: 2.1 time: 0.093887 May 18 17:15:10.586722 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 388/789] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:10 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:11.615360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a5ead9e9-fd6c-48e2-bc65-2ee0c10678af tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:11.616923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a5ead9e9-fd6c-48e2-bc65-2ee0c10678af tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:11.634661 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5ead9e9-fd6c-48e2-bc65-2ee0c10678af tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:11.635122 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5ead9e9-fd6c-48e2-bc65-2ee0c10678af tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:11.635993 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5ead9e9-fd6c-48e2-bc65-2ee0c10678af tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:11.636433 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a5ead9e9-fd6c-48e2-bc65-2ee0c10678af tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:11.869629 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a5ead9e9-fd6c-48e2-bc65-2ee0c10678af tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:11.884251 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a5ead9e9-fd6c-48e2-bc65-2ee0c10678af tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.283723 May 18 17:15:11.886186 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 402/790] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:11 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:12.407108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-cd298d51-b9ea-4590-b18e-7fb3bd0c4ae9 req-dd92816a-6f98-49bb-8f64-540377efbd06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f69790-703a-4113-8e50-78596b799cf8", "tag": "de7989e0-a808-420c-bd56-6a7ded825afb"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:15:12.419495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-cd298d51-b9ea-4590-b18e-7fb3bd0c4ae9 req-dd92816a-6f98-49bb-8f64-540377efbd06 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:12.420459 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-cd298d51-b9ea-4590-b18e-7fb3bd0c4ae9 req-dd92816a-6f98-49bb-8f64-540377efbd06 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:12.438039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-cd298d51-b9ea-4590-b18e-7fb3bd0c4ae9 req-dd92816a-6f98-49bb-8f64-540377efbd06 service nova] Creating event network-changed:de7989e0-a808-420c-bd56-6a7ded825afb for instance 96f69790-703a-4113-8e50-78596b799cf8 on hv-cinder-79578 May 18 17:15:12.443443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-cd298d51-b9ea-4590-b18e-7fb3bd0c4ae9 req-dd92816a-6f98-49bb-8f64-540377efbd06 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041270 May 18 17:15:12.444092 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 389/791] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:15:12.905194 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-780ed1e4-6639-4745-9a5c-5e9d4f367a1c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:12.906111 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-780ed1e4-6639-4745-9a5c-5e9d4f367a1c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:12.915398 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-780ed1e4-6639-4745-9a5c-5e9d4f367a1c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:12.915932 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-780ed1e4-6639-4745-9a5c-5e9d4f367a1c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:12.917268 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-780ed1e4-6639-4745-9a5c-5e9d4f367a1c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:12.918692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-780ed1e4-6639-4745-9a5c-5e9d4f367a1c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:13.134833 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-780ed1e4-6639-4745-9a5c-5e9d4f367a1c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:13.144314 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-780ed1e4-6639-4745-9a5c-5e9d4f367a1c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.242451 May 18 17:15:13.144744 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 403/792] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:12 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:14.162610 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-03f3de3e-2803-4f79-8d75-8a6285a247df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:14.163502 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-03f3de3e-2803-4f79-8d75-8a6285a247df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:14.170563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-03f3de3e-2803-4f79-8d75-8a6285a247df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:14.171013 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-03f3de3e-2803-4f79-8d75-8a6285a247df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:14.171794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-03f3de3e-2803-4f79-8d75-8a6285a247df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:14.172229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-03f3de3e-2803-4f79-8d75-8a6285a247df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:14.320565 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-03f3de3e-2803-4f79-8d75-8a6285a247df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:14.328477 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-03f3de3e-2803-4f79-8d75-8a6285a247df tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.171660 May 18 17:15:14.329058 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 390/793] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:14 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:15.346844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b05cc9c4-f179-4a84-afcc-0cd44a06e7f3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:15.347380 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b05cc9c4-f179-4a84-afcc-0cd44a06e7f3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:15.353922 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b05cc9c4-f179-4a84-afcc-0cd44a06e7f3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:15.354376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b05cc9c4-f179-4a84-afcc-0cd44a06e7f3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:15.355148 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b05cc9c4-f179-4a84-afcc-0cd44a06e7f3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:15.355585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b05cc9c4-f179-4a84-afcc-0cd44a06e7f3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:15.495478 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b05cc9c4-f179-4a84-afcc-0cd44a06e7f3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:15.502817 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b05cc9c4-f179-4a84-afcc-0cd44a06e7f3 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.160412 May 18 17:15:15.503368 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 404/794] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:15 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:16.519397 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ee7fd1aa-2217-48c4-965e-d038a134e426 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:16.520013 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ee7fd1aa-2217-48c4-965e-d038a134e426 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:16.522710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:16.528286 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ee7fd1aa-2217-48c4-965e-d038a134e426 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:16.528730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ee7fd1aa-2217-48c4-965e-d038a134e426 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:16.529500 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ee7fd1aa-2217-48c4-965e-d038a134e426 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:16.529972 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ee7fd1aa-2217-48c4-965e-d038a134e426 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:16.665629 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ee7fd1aa-2217-48c4-965e-d038a134e426 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:16.672995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ee7fd1aa-2217-48c4-965e-d038a134e426 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.157513 May 18 17:15:16.673549 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 391/795] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:16 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:15:17.691004 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fd82bfd0-1112-4106-a6b6-3752e7c505b0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:17.691633 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fd82bfd0-1112-4106-a6b6-3752e7c505b0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:17.693971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:17.694981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:17.704399 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd82bfd0-1112-4106-a6b6-3752e7c505b0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:17.704399 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd82bfd0-1112-4106-a6b6-3752e7c505b0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:17.704399 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd82bfd0-1112-4106-a6b6-3752e7c505b0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:17.704399 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd82bfd0-1112-4106-a6b6-3752e7c505b0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:17.842327 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fd82bfd0-1112-4106-a6b6-3752e7c505b0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:17.849970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fd82bfd0-1112-4106-a6b6-3752e7c505b0 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.163571 May 18 17:15:17.850566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 405/796] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:17 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:18.867030 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fdf03fc7-c217-4b26-9203-dacca4cc329b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:18.867690 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fdf03fc7-c217-4b26-9203-dacca4cc329b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:18.874281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fdf03fc7-c217-4b26-9203-dacca4cc329b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:18.874667 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fdf03fc7-c217-4b26-9203-dacca4cc329b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:18.875441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fdf03fc7-c217-4b26-9203-dacca4cc329b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:18.875879 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fdf03fc7-c217-4b26-9203-dacca4cc329b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:19.014344 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fdf03fc7-c217-4b26-9203-dacca4cc329b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:19.022942 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fdf03fc7-c217-4b26-9203-dacca4cc329b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.159866 May 18 17:15:19.023515 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 392/797] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:18 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:20.040219 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0fc41c86-6bcc-40bf-9dfe-b1f4c3a09712 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:20.040855 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0fc41c86-6bcc-40bf-9dfe-b1f4c3a09712 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:20.043164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:20.048458 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fc41c86-6bcc-40bf-9dfe-b1f4c3a09712 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:20.049592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fc41c86-6bcc-40bf-9dfe-b1f4c3a09712 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:20.050401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fc41c86-6bcc-40bf-9dfe-b1f4c3a09712 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:20.050866 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0fc41c86-6bcc-40bf-9dfe-b1f4c3a09712 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:20.054111 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:20.183870 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0fc41c86-6bcc-40bf-9dfe-b1f4c3a09712 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:20.191281 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0fc41c86-6bcc-40bf-9dfe-b1f4c3a09712 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.155008 May 18 17:15:20.191849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 406/798] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:20 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:21.208060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-dcf1bc28-e9c9-4e60-a0cf-53830b78df11 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:21.208805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-dcf1bc28-e9c9-4e60-a0cf-53830b78df11 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:21.215359 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dcf1bc28-e9c9-4e60-a0cf-53830b78df11 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:21.215809 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dcf1bc28-e9c9-4e60-a0cf-53830b78df11 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:21.216580 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dcf1bc28-e9c9-4e60-a0cf-53830b78df11 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:21.217276 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-dcf1bc28-e9c9-4e60-a0cf-53830b78df11 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:21.362454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-dcf1bc28-e9c9-4e60-a0cf-53830b78df11 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:21.371017 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-dcf1bc28-e9c9-4e60-a0cf-53830b78df11 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.167378 May 18 17:15:21.371585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 393/799] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:21 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:22.390083 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7f61759e-365b-4b26-ac86-28fc46f23143 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:22.390650 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7f61759e-365b-4b26-ac86-28fc46f23143 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:22.397882 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7f61759e-365b-4b26-ac86-28fc46f23143 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:22.398340 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7f61759e-365b-4b26-ac86-28fc46f23143 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:22.399121 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7f61759e-365b-4b26-ac86-28fc46f23143 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:22.399563 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7f61759e-365b-4b26-ac86-28fc46f23143 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:22.536722 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7f61759e-365b-4b26-ac86-28fc46f23143 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:22.544421 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7f61759e-365b-4b26-ac86-28fc46f23143 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.158413 May 18 17:15:22.545007 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 407/800] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:22 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:23.562250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-812e1171-20e7-4324-ad1c-762b43840808 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:23.562860 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-812e1171-20e7-4324-ad1c-762b43840808 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:23.570210 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-812e1171-20e7-4324-ad1c-762b43840808 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:23.570667 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-812e1171-20e7-4324-ad1c-762b43840808 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:23.571448 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-812e1171-20e7-4324-ad1c-762b43840808 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:23.571885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-812e1171-20e7-4324-ad1c-762b43840808 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:23.723855 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-812e1171-20e7-4324-ad1c-762b43840808 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:23.731526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-812e1171-20e7-4324-ad1c-762b43840808 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.173092 May 18 17:15:23.732104 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 394/801] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:23 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:24.748436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4949e422-ac4e-433d-b5da-37b8b281ca79 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:24.749072 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4949e422-ac4e-433d-b5da-37b8b281ca79 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:24.756360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4949e422-ac4e-433d-b5da-37b8b281ca79 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:24.756817 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4949e422-ac4e-433d-b5da-37b8b281ca79 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:24.757600 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4949e422-ac4e-433d-b5da-37b8b281ca79 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:24.758071 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4949e422-ac4e-433d-b5da-37b8b281ca79 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:24.895890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4949e422-ac4e-433d-b5da-37b8b281ca79 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:24.903600 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4949e422-ac4e-433d-b5da-37b8b281ca79 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.159019 May 18 17:15:24.904172 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 408/802] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:24 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:25.878428 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-2b43213f-0d4f-400d-8406-9b17f077af1c req-11de93e4-26c0-4ac2-8689-743c04dbd237 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f69790-703a-4113-8e50-78596b799cf8", "name": "network-vif-plugged", "status": "completed", "tag": "de7989e0-a808-420c-bd56-6a7ded825afb"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:15:25.887667 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-2b43213f-0d4f-400d-8406-9b17f077af1c req-11de93e4-26c0-4ac2-8689-743c04dbd237 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:25.888172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-2b43213f-0d4f-400d-8406-9b17f077af1c req-11de93e4-26c0-4ac2-8689-743c04dbd237 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:25.903479 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-2b43213f-0d4f-400d-8406-9b17f077af1c req-11de93e4-26c0-4ac2-8689-743c04dbd237 service nova] Creating event network-vif-plugged:de7989e0-a808-420c-bd56-6a7ded825afb for instance 96f69790-703a-4113-8e50-78596b799cf8 on hv-cinder-79578 May 18 17:15:25.910317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-2b43213f-0d4f-400d-8406-9b17f077af1c req-11de93e4-26c0-4ac2-8689-743c04dbd237 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035423 May 18 17:15:25.910936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 395/803] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:15:25.925369 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e2269e71-a8ea-4ca7-a57c-2f7401c165bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:25.926140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e2269e71-a8ea-4ca7-a57c-2f7401c165bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:25.932817 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2269e71-a8ea-4ca7-a57c-2f7401c165bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:25.933268 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2269e71-a8ea-4ca7-a57c-2f7401c165bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:25.934081 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2269e71-a8ea-4ca7-a57c-2f7401c165bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:25.934584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e2269e71-a8ea-4ca7-a57c-2f7401c165bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:26.099058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e2269e71-a8ea-4ca7-a57c-2f7401c165bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:26.106704 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e2269e71-a8ea-4ca7-a57c-2f7401c165bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.185795 May 18 17:15:26.107271 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 409/804] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:25 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:27.124560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ad564f79-a891-4bae-b91b-43472f8e658c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:27.125285 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ad564f79-a891-4bae-b91b-43472f8e658c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:27.127656 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:27.133909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ad564f79-a891-4bae-b91b-43472f8e658c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:27.134361 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ad564f79-a891-4bae-b91b-43472f8e658c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:27.135132 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ad564f79-a891-4bae-b91b-43472f8e658c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:27.135585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ad564f79-a891-4bae-b91b-43472f8e658c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:27.139188 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:27.268651 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ad564f79-a891-4bae-b91b-43472f8e658c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:27.277877 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ad564f79-a891-4bae-b91b-43472f8e658c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1365 microversion: 2.1 time: 0.157412 May 18 17:15:27.278465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 396/805] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:27 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:28.295273 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-90a24d48-b765-4a31-ac11-98a4f072f821 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:28.295811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-90a24d48-b765-4a31-ac11-98a4f072f821 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:28.303090 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-90a24d48-b765-4a31-ac11-98a4f072f821 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:28.303546 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-90a24d48-b765-4a31-ac11-98a4f072f821 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:28.304318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-90a24d48-b765-4a31-ac11-98a4f072f821 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:28.304762 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-90a24d48-b765-4a31-ac11-98a4f072f821 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:28.436522 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-90a24d48-b765-4a31-ac11-98a4f072f821 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:28.445590 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-90a24d48-b765-4a31-ac11-98a4f072f821 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1554 microversion: 2.1 time: 0.154211 May 18 17:15:28.446201 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 410/806] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:28 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:28.462224 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-24d5f15e-f2c7-4112-9a50-ec65433546bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:28.462754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-24d5f15e-f2c7-4112-9a50-ec65433546bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:28.469790 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24d5f15e-f2c7-4112-9a50-ec65433546bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:28.470248 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24d5f15e-f2c7-4112-9a50-ec65433546bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:28.472120 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24d5f15e-f2c7-4112-9a50-ec65433546bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:28.472562 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-24d5f15e-f2c7-4112-9a50-ec65433546bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:28.552659 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-24d5f15e-f2c7-4112-9a50-ec65433546bd tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094234 May 18 17:15:28.553255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 397/807] 10.222.0.49 () {58 vars in 1274 bytes} [Wed May 18 17:15:28 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:15:29.506305 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-f329090d-8ca0-45ff-b777-4fa6b55cfaaa req-9a0aa57d-f1c2-4b9b-a7a3-6660dd0cbcb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96f69790-703a-4113-8e50-78596b799cf8", "tag": "de7989e0-a808-420c-bd56-6a7ded825afb"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:15:29.517510 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f329090d-8ca0-45ff-b777-4fa6b55cfaaa req-9a0aa57d-f1c2-4b9b-a7a3-6660dd0cbcb5 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:29.518059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f329090d-8ca0-45ff-b777-4fa6b55cfaaa req-9a0aa57d-f1c2-4b9b-a7a3-6660dd0cbcb5 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:29.534036 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-f329090d-8ca0-45ff-b777-4fa6b55cfaaa req-9a0aa57d-f1c2-4b9b-a7a3-6660dd0cbcb5 service nova] Creating event network-changed:de7989e0-a808-420c-bd56-6a7ded825afb for instance 96f69790-703a-4113-8e50-78596b799cf8 on hv-cinder-79578 May 18 17:15:29.538270 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-f329090d-8ca0-45ff-b777-4fa6b55cfaaa req-9a0aa57d-f1c2-4b9b-a7a3-6660dd0cbcb5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035796 May 18 17:15:29.538890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 411/808] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:15:50.370239 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:50.370989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=9 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:50.375479 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-99f693f6-cecf-4d21-8c30-e3dbd5367052 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Action: 'create', calling method: .version_select at 0x7fef001e0040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-414767752", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI2QrHCRKVFwX3SMRY2U5/A2szq4V5CRA+kHegMEV/j6kgqM3HVegFahyXuulAc3ej3gm0ii8OWg26MGnJVMrF+TVRUEFV3zyol9K34IzOU2zkyB67gYmxFrLhrEjPvk/g=="}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:15:50.392679 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-99f693f6-cecf-4d21-8c30-e3dbd5367052 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Getting quotas for project dd5a225077df40c6b99ae3e05740d44e. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:15:50.396692 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-99f693f6-cecf-4d21-8c30-e3dbd5367052 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Getting quotas for user 6b0deb40045e47cba7ed81b1ae6b528d and project dd5a225077df40c6b99ae3e05740d44e. Resources: {'key_pairs'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:15:50.418849 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-99f693f6-cecf-4d21-8c30-e3dbd5367052 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.049903 May 18 17:15:50.419445 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 398/809] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:15:50 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:15:50.468749 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=11 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:50.469524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=31 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:15:50.474757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-93076736", "imageRef": "c0ed59b2-04f1-40f3-9991-59a50dae8f9e", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-414767752", "networks": [{"uuid": "7c71ab70-60db-4861-9fea-85f8765e35ae"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:15:50.536288 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] validate_networks() for [('7c71ab70-60db-4861-9fea-85f8765e35ae', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:15:50.929277 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:15:50.929787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:15:50.930269 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:15:50.930685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:15:50.931101 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:15:50.943147 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:50.943596 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:50.944431 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:50.944869 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:50.965312 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Getting quotas for project dd5a225077df40c6b99ae3e05740d44e. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:15:50.969873 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Getting quotas for user 6b0deb40045e47cba7ed81b1ae6b528d and project dd5a225077df40c6b99ae3e05740d44e. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:15:50.982837 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:15:50.985232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c0ed59b2-04f1-40f3-9991-59a50dae8f9e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:15:51.047374 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ad047914-655e-436c-b104-311fa7fa7a57 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580428 May 18 17:15:51.048568 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 412/810] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:15:51.060444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9074c979-6e6c-42b8-9f74-efee0d668391 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:51.061071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9074c979-6e6c-42b8-9f74-efee0d668391 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:51.132560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9074c979-6e6c-42b8-9f74-efee0d668391 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:51.143500 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9074c979-6e6c-42b8-9f74-efee0d668391 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1256 microversion: 2.1 time: 0.087218 May 18 17:15:51.144088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 399/811] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:51 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1256 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:52.162940 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02a87a01-e0ed-468c-bb44-cf824ef3ade7 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:52.163839 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02a87a01-e0ed-468c-bb44-cf824ef3ade7 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:52.170921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02a87a01-e0ed-468c-bb44-cf824ef3ade7 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:52.171370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02a87a01-e0ed-468c-bb44-cf824ef3ade7 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:52.172142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02a87a01-e0ed-468c-bb44-cf824ef3ade7 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:52.172579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02a87a01-e0ed-468c-bb44-cf824ef3ade7 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:52.253030 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02a87a01-e0ed-468c-bb44-cf824ef3ade7 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:52.266680 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02a87a01-e0ed-468c-bb44-cf824ef3ade7 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1316 microversion: 2.1 time: 0.109636 May 18 17:15:52.276742 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 413/812] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:52 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1316 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:53.285808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4c194557-2ea9-4503-bb38-447344e55f84 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:53.286478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4c194557-2ea9-4503-bb38-447344e55f84 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:53.293173 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4c194557-2ea9-4503-bb38-447344e55f84 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:53.293605 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4c194557-2ea9-4503-bb38-447344e55f84 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:53.294624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4c194557-2ea9-4503-bb38-447344e55f84 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:53.295045 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4c194557-2ea9-4503-bb38-447344e55f84 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:53.633349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4c194557-2ea9-4503-bb38-447344e55f84 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:53.641429 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4c194557-2ea9-4503-bb38-447344e55f84 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.360004 May 18 17:15:53.642064 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 400/813] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:53 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:15:54.661047 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-731920c9-a023-4224-b722-06c2fb1fe2c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:54.661959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-731920c9-a023-4224-b722-06c2fb1fe2c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:54.671404 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-731920c9-a023-4224-b722-06c2fb1fe2c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:54.671865 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-731920c9-a023-4224-b722-06c2fb1fe2c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:54.672639 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-731920c9-a023-4224-b722-06c2fb1fe2c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:54.673266 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-731920c9-a023-4224-b722-06c2fb1fe2c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:54.907200 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-731920c9-a023-4224-b722-06c2fb1fe2c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:54.917284 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-731920c9-a023-4224-b722-06c2fb1fe2c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.261605 May 18 17:15:54.918287 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 414/814] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:54 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:55.936325 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-badc9c6a-e629-423d-a66b-2ed035a87127 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:55.937025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-badc9c6a-e629-423d-a66b-2ed035a87127 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:55.944962 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-badc9c6a-e629-423d-a66b-2ed035a87127 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:55.945811 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-badc9c6a-e629-423d-a66b-2ed035a87127 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:55.946684 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-badc9c6a-e629-423d-a66b-2ed035a87127 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:55.947133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-badc9c6a-e629-423d-a66b-2ed035a87127 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:56.108150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-badc9c6a-e629-423d-a66b-2ed035a87127 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:56.117082 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-badc9c6a-e629-423d-a66b-2ed035a87127 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.184676 May 18 17:15:56.117790 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 401/815] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:55 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:57.133322 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ab7b0a99-848f-499e-b323-df111645f66a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:57.133972 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ab7b0a99-848f-499e-b323-df111645f66a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:57.140592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab7b0a99-848f-499e-b323-df111645f66a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:57.141044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab7b0a99-848f-499e-b323-df111645f66a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:57.141861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab7b0a99-848f-499e-b323-df111645f66a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:57.142305 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ab7b0a99-848f-499e-b323-df111645f66a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:57.286352 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ab7b0a99-848f-499e-b323-df111645f66a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:57.293927 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ab7b0a99-848f-499e-b323-df111645f66a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.164349 May 18 17:15:57.294512 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 415/816] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:57 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:58.311614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5ae54f6c-d60f-4935-a652-254f80e17a74 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:58.312187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5ae54f6c-d60f-4935-a652-254f80e17a74 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:58.318478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ae54f6c-d60f-4935-a652-254f80e17a74 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:58.318920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ae54f6c-d60f-4935-a652-254f80e17a74 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:58.319687 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ae54f6c-d60f-4935-a652-254f80e17a74 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:58.320118 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5ae54f6c-d60f-4935-a652-254f80e17a74 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:58.457150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5ae54f6c-d60f-4935-a652-254f80e17a74 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:58.464776 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5ae54f6c-d60f-4935-a652-254f80e17a74 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.157108 May 18 17:15:58.465338 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 402/817] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:58 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:15:59.198721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c81a08e9-b5ae-404f-87b3-ae6c6b8bbfc7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:59.199357 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c81a08e9-b5ae-404f-87b3-ae6c6b8bbfc7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:59.206965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c81a08e9-b5ae-404f-87b3-ae6c6b8bbfc7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:59.207417 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c81a08e9-b5ae-404f-87b3-ae6c6b8bbfc7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:59.208213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c81a08e9-b5ae-404f-87b3-ae6c6b8bbfc7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:59.208653 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c81a08e9-b5ae-404f-87b3-ae6c6b8bbfc7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:59.236591 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c81a08e9-b5ae-404f-87b3-ae6c6b8bbfc7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/ips" status: 200 len: 152 microversion: 2.20 time: 0.040952 May 18 17:15:59.237389 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 416/818] 10.222.0.49 () {60 vars in 1288 bytes} [Wed May 18 17:15:59 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:15:59.487431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-694eec35-a4d7-470c-bd08-c27fc45f0dae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:15:59.488057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-694eec35-a4d7-470c-bd08-c27fc45f0dae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:15:59.495973 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-694eec35-a4d7-470c-bd08-c27fc45f0dae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:59.496457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-694eec35-a4d7-470c-bd08-c27fc45f0dae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:59.497237 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-694eec35-a4d7-470c-bd08-c27fc45f0dae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:15:59.497699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-694eec35-a4d7-470c-bd08-c27fc45f0dae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:15:59.652810 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-694eec35-a4d7-470c-bd08-c27fc45f0dae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:15:59.662266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-694eec35-a4d7-470c-bd08-c27fc45f0dae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.182842 May 18 17:15:59.662877 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 403/819] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:15:59 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:00.681634 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f40d795d-95de-4d9d-b468-4772b9748412 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:00.682372 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f40d795d-95de-4d9d-b468-4772b9748412 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:00.696041 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f40d795d-95de-4d9d-b468-4772b9748412 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:00.696608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f40d795d-95de-4d9d-b468-4772b9748412 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:00.697736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f40d795d-95de-4d9d-b468-4772b9748412 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:00.698448 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f40d795d-95de-4d9d-b468-4772b9748412 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:00.847641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f40d795d-95de-4d9d-b468-4772b9748412 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:00.856589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f40d795d-95de-4d9d-b468-4772b9748412 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.178546 May 18 17:16:00.857098 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 417/820] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:00 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:01.874775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d9d913bb-37ef-4cce-a4d5-583d71b80644 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:01.875327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d9d913bb-37ef-4cce-a4d5-583d71b80644 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:01.878416 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:01.884655 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d9d913bb-37ef-4cce-a4d5-583d71b80644 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:01.885106 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d9d913bb-37ef-4cce-a4d5-583d71b80644 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:01.885989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d9d913bb-37ef-4cce-a4d5-583d71b80644 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:01.886430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d9d913bb-37ef-4cce-a4d5-583d71b80644 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:02.025549 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d9d913bb-37ef-4cce-a4d5-583d71b80644 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:02.033562 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d9d913bb-37ef-4cce-a4d5-583d71b80644 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.162854 May 18 17:16:02.035089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 404/821] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:01 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:02.138781 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f9b970d4-b438-49d7-9361-24fb9cb9f3e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:02.139404 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f9b970d4-b438-49d7-9361-24fb9cb9f3e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:02.141470 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:02.142243 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:02.149523 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f9b970d4-b438-49d7-9361-24fb9cb9f3e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:02.150027 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f9b970d4-b438-49d7-9361-24fb9cb9f3e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:02.150808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f9b970d4-b438-49d7-9361-24fb9cb9f3e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:02.151244 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f9b970d4-b438-49d7-9361-24fb9cb9f3e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:02.175898 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-f9b970d4-b438-49d7-9361-24fb9cb9f3e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lazy-loading 'flavor' on Instance uuid f53e5299-6ac2-4849-a4c1-01924709ff00 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:16:02.454706 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f9b970d4-b438-49d7-9361-24fb9cb9f3e8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/action" status: 202 len: 0 microversion: 2.20 time: 0.319799 May 18 17:16:02.455348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 418/822] 10.222.0.49 () {62 vars in 1318 bytes} [Wed May 18 17:16:02 2022] POST /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 17:16:02.463572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:02.464186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:02.470672 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:02.471120 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:02.472519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:02.472975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:02.627275 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:02.636876 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:02.638569 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:02.639839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2a14f5fe-94ab-4d47-9602-740dbc80ed35 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.180161 May 18 17:16:02.640717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 405/823] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:02 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:03.052817 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ae5edeba-18ce-4bcf-8498-c73869d12912 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:03.053538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ae5edeba-18ce-4bcf-8498-c73869d12912 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:03.069852 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ae5edeba-18ce-4bcf-8498-c73869d12912 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:03.070323 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ae5edeba-18ce-4bcf-8498-c73869d12912 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:03.071206 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ae5edeba-18ce-4bcf-8498-c73869d12912 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:03.071668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ae5edeba-18ce-4bcf-8498-c73869d12912 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:03.241806 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ae5edeba-18ce-4bcf-8498-c73869d12912 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:03.250093 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ae5edeba-18ce-4bcf-8498-c73869d12912 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.202258 May 18 17:16:03.250897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 419/824] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:03 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:16:03.659739 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:03.660446 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:03.668319 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:03.668767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:03.669565 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:03.670080 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:03.808833 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:03.818907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:03.820433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:03.821630 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8ee8ad53-7fbd-4037-a5f0-bdce2973889a tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.166443 May 18 17:16:03.822235 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 406/825] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:03 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:04.266891 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-29096ab8-a77e-4c83-8bd6-ad4ddf65c696 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:04.267491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-29096ab8-a77e-4c83-8bd6-ad4ddf65c696 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:04.274598 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29096ab8-a77e-4c83-8bd6-ad4ddf65c696 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:04.275036 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29096ab8-a77e-4c83-8bd6-ad4ddf65c696 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:04.275791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29096ab8-a77e-4c83-8bd6-ad4ddf65c696 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:04.276217 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-29096ab8-a77e-4c83-8bd6-ad4ddf65c696 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:04.409005 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-29096ab8-a77e-4c83-8bd6-ad4ddf65c696 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:04.416457 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-29096ab8-a77e-4c83-8bd6-ad4ddf65c696 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.153357 May 18 17:16:04.417270 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 420/826] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:04 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:04.840159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:04.840770 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:04.849260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:04.849949 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:04.850567 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:04.851008 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:04.983864 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:04.993010 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:04.994562 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:04.995711 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4ad0263e-2244-453f-adce-ef833ead689e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.159581 May 18 17:16:04.996264 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 407/827] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:04 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:05.434103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5d1742d6-d0bb-458c-b11a-c269a036cfe5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:05.434746 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5d1742d6-d0bb-458c-b11a-c269a036cfe5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:05.441834 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d1742d6-d0bb-458c-b11a-c269a036cfe5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:05.442285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d1742d6-d0bb-458c-b11a-c269a036cfe5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:05.443079 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d1742d6-d0bb-458c-b11a-c269a036cfe5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:05.443526 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5d1742d6-d0bb-458c-b11a-c269a036cfe5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:05.572933 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5d1742d6-d0bb-458c-b11a-c269a036cfe5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:05.580384 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5d1742d6-d0bb-458c-b11a-c269a036cfe5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.150137 May 18 17:16:05.581579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 421/828] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:05 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:06.014588 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:06.015238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:06.022371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:06.022827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:06.023596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:06.024041 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:06.316119 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:06.324516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:06.326049 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:06.327222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-96f54cac-d0e5-455d-a153-08366f1a69e6 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.316512 May 18 17:16:06.327801 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 408/829] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:06 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:06.597755 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fd370531-51ec-4201-8633-fe8e380faf0d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:06.598399 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fd370531-51ec-4201-8633-fe8e380faf0d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:06.608210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd370531-51ec-4201-8633-fe8e380faf0d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:06.608618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd370531-51ec-4201-8633-fe8e380faf0d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:06.609276 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd370531-51ec-4201-8633-fe8e380faf0d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:06.609728 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd370531-51ec-4201-8633-fe8e380faf0d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:06.748693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fd370531-51ec-4201-8633-fe8e380faf0d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:06.757646 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fd370531-51ec-4201-8633-fe8e380faf0d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.163719 May 18 17:16:06.758270 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 422/830] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:06 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:07.327990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-1be30989-1b90-468d-93eb-d3798aad2884 req-e68f62f5-87db-4318-bf24-5dca53fcbb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749c046f-33ee-458b-a080-584bdbc4549a", "tag": "83599677-1718-443a-b9f2-afbf3863f167"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:07.348148 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:07.348966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:07.358954 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1be30989-1b90-468d-93eb-d3798aad2884 req-e68f62f5-87db-4318-bf24-5dca53fcbb8d service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:07.359554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-1be30989-1b90-468d-93eb-d3798aad2884 req-e68f62f5-87db-4318-bf24-5dca53fcbb8d service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:07.363643 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:07.366395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:07.367333 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:07.371233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:07.389772 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-1be30989-1b90-468d-93eb-d3798aad2884 req-e68f62f5-87db-4318-bf24-5dca53fcbb8d service nova] Creating event network-changed:83599677-1718-443a-b9f2-afbf3863f167 for instance 749c046f-33ee-458b-a080-584bdbc4549a on hv-cinder-79578 May 18 17:16:07.400646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-1be30989-1b90-468d-93eb-d3798aad2884 req-e68f62f5-87db-4318-bf24-5dca53fcbb8d service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076653 May 18 17:16:07.401406 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 409/831] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:07.543547 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:07.551884 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:07.553382 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:07.554634 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bb66e066-7168-40bb-9b52-346b1174b449 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.213417 May 18 17:16:07.555195 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 423/832] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:07 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:07.775166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7d116f76-f128-4d65-a6a7-fc941c9d61ce tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:07.775860 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7d116f76-f128-4d65-a6a7-fc941c9d61ce tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:07.782160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d116f76-f128-4d65-a6a7-fc941c9d61ce tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:07.782610 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d116f76-f128-4d65-a6a7-fc941c9d61ce tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:07.783397 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d116f76-f128-4d65-a6a7-fc941c9d61ce tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:07.783878 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7d116f76-f128-4d65-a6a7-fc941c9d61ce tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:07.918798 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7d116f76-f128-4d65-a6a7-fc941c9d61ce tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:07.926907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7d116f76-f128-4d65-a6a7-fc941c9d61ce tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.155846 May 18 17:16:07.927489 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 410/833] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:07 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:08.572303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:08.572890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:08.579391 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:08.579833 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:08.580630 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:08.581214 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:08.710143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:08.718202 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:08.719683 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:08.720821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b12d3f60-f315-4c87-92f0-58d2232c283f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.152407 May 18 17:16:08.722166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 424/834] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:08 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:08.944231 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-25eb95c9-df5c-4c52-b7b0-87f188d3c4dd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:08.944851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-25eb95c9-df5c-4c52-b7b0-87f188d3c4dd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:08.951360 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25eb95c9-df5c-4c52-b7b0-87f188d3c4dd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:08.951850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25eb95c9-df5c-4c52-b7b0-87f188d3c4dd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:08.952585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25eb95c9-df5c-4c52-b7b0-87f188d3c4dd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:08.953019 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-25eb95c9-df5c-4c52-b7b0-87f188d3c4dd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:09.083552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-25eb95c9-df5c-4c52-b7b0-87f188d3c4dd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:09.091015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-25eb95c9-df5c-4c52-b7b0-87f188d3c4dd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.150963 May 18 17:16:09.091602 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 411/835] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:08 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:09.739888 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:09.740543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:09.747138 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:09.747594 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:09.748369 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:09.748814 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:09.886842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:09.894852 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:09.896342 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:09.897568 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-abc99388-1d47-4e8a-bf7e-1cc521e8d25e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.161896 May 18 17:16:09.898066 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 425/836] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:09 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:10.108875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-faf76981-7268-4000-a908-61231e56571c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:10.109495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-faf76981-7268-4000-a908-61231e56571c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:10.117066 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-faf76981-7268-4000-a908-61231e56571c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:10.117522 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-faf76981-7268-4000-a908-61231e56571c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:10.118343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-faf76981-7268-4000-a908-61231e56571c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:10.118816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-faf76981-7268-4000-a908-61231e56571c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:10.252966 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-faf76981-7268-4000-a908-61231e56571c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:10.260355 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-faf76981-7268-4000-a908-61231e56571c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.155328 May 18 17:16:10.260914 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 412/837] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:10 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:10.915691 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:10.916226 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:10.922685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:10.923136 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:10.923882 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:10.924916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:11.054774 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:11.062921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:11.064431 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:11.065800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-97a5a32a-c13e-4cae-9638-2f28b8920cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.153946 May 18 17:16:11.066280 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 426/838] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:10 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:11.277219 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-09e9ddcf-7f09-4792-94f8-d8a33740b48d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:11.277992 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-09e9ddcf-7f09-4792-94f8-d8a33740b48d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:11.284987 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-09e9ddcf-7f09-4792-94f8-d8a33740b48d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:11.285430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-09e9ddcf-7f09-4792-94f8-d8a33740b48d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:11.286215 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-09e9ddcf-7f09-4792-94f8-d8a33740b48d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:11.286648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-09e9ddcf-7f09-4792-94f8-d8a33740b48d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:11.415723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-09e9ddcf-7f09-4792-94f8-d8a33740b48d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:11.423179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-09e9ddcf-7f09-4792-94f8-d8a33740b48d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.149789 May 18 17:16:11.423748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 413/839] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:11 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:12.084541 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:12.085936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:12.093708 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:12.094299 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:12.095363 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:12.096015 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:12.131645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:12.256194 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:12.264447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:12.265983 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:12.267151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3af73594-5d82-4b75-91a9-c4a3f1402a08 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.187183 May 18 17:16:12.267728 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 427/840] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:12 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:12.440661 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f47c6701-6dab-46d3-8005-c946e366ba70 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:12.441278 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f47c6701-6dab-46d3-8005-c946e366ba70 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:12.448108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f47c6701-6dab-46d3-8005-c946e366ba70 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:12.448572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f47c6701-6dab-46d3-8005-c946e366ba70 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:12.449365 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f47c6701-6dab-46d3-8005-c946e366ba70 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:12.449838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f47c6701-6dab-46d3-8005-c946e366ba70 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:12.583111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f47c6701-6dab-46d3-8005-c946e366ba70 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:12.590539 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f47c6701-6dab-46d3-8005-c946e366ba70 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.154059 May 18 17:16:12.591187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 414/841] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:12 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:13.000389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:16:13.000555 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:16:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:16:13.287039 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:13.287608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:13.294325 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:13.294779 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:13.295546 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:13.295987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:13.364791 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-af80f6b2-b991-4be3-a400-d3bcc849cbf5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:13.365289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-af80f6b2-b991-4be3-a400-d3bcc849cbf5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:13.371552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-af80f6b2-b991-4be3-a400-d3bcc849cbf5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:13.371938 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-af80f6b2-b991-4be3-a400-d3bcc849cbf5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:13.372718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-af80f6b2-b991-4be3-a400-d3bcc849cbf5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:13.373162 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-af80f6b2-b991-4be3-a400-d3bcc849cbf5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:13.399177 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-af80f6b2-b991-4be3-a400-d3bcc849cbf5 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/ips" status: 200 len: 145 microversion: 2.1 time: 0.038960 May 18 17:16:13.399743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 415/842] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:16:13 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:16:13.433978 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:13.443355 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:13.444863 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:13.446060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-abc1565b-cbf7-4a75-9c4a-811c3cfa732f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.164013 May 18 17:16:13.446630 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 428/843] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:13 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:13.609518 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7fc87539-7f45-42b1-ae3b-c7b8cfee34ae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:13.611057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7fc87539-7f45-42b1-ae3b-c7b8cfee34ae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:13.619062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fc87539-7f45-42b1-ae3b-c7b8cfee34ae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:13.619495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fc87539-7f45-42b1-ae3b-c7b8cfee34ae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:13.620268 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fc87539-7f45-42b1-ae3b-c7b8cfee34ae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:13.620699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7fc87539-7f45-42b1-ae3b-c7b8cfee34ae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:13.768584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7fc87539-7f45-42b1-ae3b-c7b8cfee34ae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:13.776910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7fc87539-7f45-42b1-ae3b-c7b8cfee34ae tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.172035 May 18 17:16:13.777586 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 416/844] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:13 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:14.071563 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-11f2e956-b122-4c05-b3e5-9b41b99829bb req-6b6f0079-c5c3-40c7-b829-b545edaba899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749c046f-33ee-458b-a080-584bdbc4549a", "name": "network-vif-plugged", "status": "completed", "tag": "83599677-1718-443a-b9f2-afbf3863f167"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:14.081242 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-11f2e956-b122-4c05-b3e5-9b41b99829bb req-6b6f0079-c5c3-40c7-b829-b545edaba899 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:14.081726 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-11f2e956-b122-4c05-b3e5-9b41b99829bb req-6b6f0079-c5c3-40c7-b829-b545edaba899 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:14.093966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-11f2e956-b122-4c05-b3e5-9b41b99829bb req-6b6f0079-c5c3-40c7-b829-b545edaba899 service nova] Creating event network-vif-plugged:83599677-1718-443a-b9f2-afbf3863f167 for instance 749c046f-33ee-458b-a080-584bdbc4549a on hv-cinder-79578 May 18 17:16:14.100252 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-11f2e956-b122-4c05-b3e5-9b41b99829bb req-6b6f0079-c5c3-40c7-b829-b545edaba899 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032615 May 18 17:16:14.100861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 429/845] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:14.464211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:14.464812 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:14.471062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:14.471622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:14.472256 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:14.472685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:14.490085 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=100 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:14.607775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:14.615980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:14.617477 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:14.618681 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-58c411b9-8354-4b4d-a597-cf1fa91f3c93 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.158436 May 18 17:16:14.619229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 417/846] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:14 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:14.796404 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d8afb8fc-0b77-458a-b715-7aefdfbcc653 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:14.797104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d8afb8fc-0b77-458a-b715-7aefdfbcc653 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:14.803955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8afb8fc-0b77-458a-b715-7aefdfbcc653 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:14.804406 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8afb8fc-0b77-458a-b715-7aefdfbcc653 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:14.805169 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8afb8fc-0b77-458a-b715-7aefdfbcc653 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:14.805608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d8afb8fc-0b77-458a-b715-7aefdfbcc653 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:14.939619 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d8afb8fc-0b77-458a-b715-7aefdfbcc653 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:14.947803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d8afb8fc-0b77-458a-b715-7aefdfbcc653 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.156124 May 18 17:16:14.948365 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 430/847] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:14 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:15.638426 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:15.639071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:15.646505 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:15.647027 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:15.647795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:15.648256 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:15.782125 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:15.785041 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f58a83d4-bd14-4263-ae7f-460467001de8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a536bbe1-f466-4928-b2e0-6bb2dddd9526"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:15.786141 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f58a83d4-bd14-4263-ae7f-460467001de8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:15.791005 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:15.792505 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:15.792976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f58a83d4-bd14-4263-ae7f-460467001de8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:15.793679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f58a83d4-bd14-4263-ae7f-460467001de8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:15.793876 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d4d55fa8-8b8f-43ca-a10c-811376e077c0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.159366 May 18 17:16:15.794251 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 418/848] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:15 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:15.794701 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f58a83d4-bd14-4263-ae7f-460467001de8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:15.795230 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f58a83d4-bd14-4263-ae7f-460467001de8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:15.964539 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-82fa9679-a35b-4b38-8cac-7e36205837a5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:15.965118 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-82fa9679-a35b-4b38-8cac-7e36205837a5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:15.972166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82fa9679-a35b-4b38-8cac-7e36205837a5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:15.972609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82fa9679-a35b-4b38-8cac-7e36205837a5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:15.973392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82fa9679-a35b-4b38-8cac-7e36205837a5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:15.973815 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-82fa9679-a35b-4b38-8cac-7e36205837a5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:16.101506 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f58a83d4-bd14-4263-ae7f-460467001de8 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320715 May 18 17:16:16.105424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 431/849] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:16:15 2022] POST /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments => generated 194 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:16:16.115017 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-82fa9679-a35b-4b38-8cac-7e36205837a5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:16.122664 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-82fa9679-a35b-4b38-8cac-7e36205837a5 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1356 microversion: 2.1 time: 0.162212 May 18 17:16:16.123334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 419/850] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:15 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:16:16.812456 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:16.813205 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:16.820381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:16.820829 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:16.821595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:16.822058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:16.960390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:16.969229 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:16.970802 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:16.972479 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b5426653-8eed-4f6e-8bbf-63583bb5f867 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.164274 May 18 17:16:16.973039 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 432/851] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:16 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:17.140989 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fc01e85f-f984-4825-a18a-d5db33f51204 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:17.141637 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fc01e85f-f984-4825-a18a-d5db33f51204 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:17.149043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc01e85f-f984-4825-a18a-d5db33f51204 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:17.149498 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc01e85f-f984-4825-a18a-d5db33f51204 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:17.150334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc01e85f-f984-4825-a18a-d5db33f51204 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:17.150793 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fc01e85f-f984-4825-a18a-d5db33f51204 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:17.282067 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fc01e85f-f984-4825-a18a-d5db33f51204 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:17.290479 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fc01e85f-f984-4825-a18a-d5db33f51204 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1546 microversion: 2.1 time: 0.153435 May 18 17:16:17.291055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 420/852] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:17 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:17.307162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-df3034be-8d57-4d72-8423-89e05ef7fe6a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:17.307773 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-df3034be-8d57-4d72-8423-89e05ef7fe6a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:17.314257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df3034be-8d57-4d72-8423-89e05ef7fe6a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:17.314944 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df3034be-8d57-4d72-8423-89e05ef7fe6a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:17.316061 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df3034be-8d57-4d72-8423-89e05ef7fe6a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:17.316355 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-df3034be-8d57-4d72-8423-89e05ef7fe6a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:17.456212 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-df3034be-8d57-4d72-8423-89e05ef7fe6a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:17.463542 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-df3034be-8d57-4d72-8423-89e05ef7fe6a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1546 microversion: 2.1 time: 0.160172 May 18 17:16:17.464101 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 433/853] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:17 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1546 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:17.479322 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:17.482694 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:17.483456 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Searching by: {'deleted': False, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e'} {{(pid=117732) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 18 17:16:17.490789 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:17.491257 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:17.492104 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:17.492538 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:17.584021 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.multi_cell_list [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117732) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 18 17:16:17.676661 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fb610fc0-ecdd-437c-bc5d-252c7859a124 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.200966 May 18 17:16:17.677242 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 421/854] 10.222.0.49 () {58 vars in 1124 bytes} [Wed May 18 17:16:17 2022] GET /compute/v2.1/servers => generated 341 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:17.687265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2e3daeec-a0ed-4dbf-8354-b960ccaa4bd2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:17.687885 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2e3daeec-a0ed-4dbf-8354-b960ccaa4bd2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:17.695050 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e3daeec-a0ed-4dbf-8354-b960ccaa4bd2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:17.695450 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e3daeec-a0ed-4dbf-8354-b960ccaa4bd2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:17.696214 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e3daeec-a0ed-4dbf-8354-b960ccaa4bd2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:17.696655 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2e3daeec-a0ed-4dbf-8354-b960ccaa4bd2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:17.832580 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-2e3daeec-a0ed-4dbf-8354-b960ccaa4bd2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:17.839902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2e3daeec-a0ed-4dbf-8354-b960ccaa4bd2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1546 microversion: 2.1 time: 0.156389 May 18 17:16:17.840460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 434/855] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:17 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:17.992501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:17.993042 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:17.999997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:18.000458 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:18.001340 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:18.001685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:18.162561 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:18.171545 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:18.173062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:18.174819 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fe4ca210-c925-49b5-b4a7-2a42a9089d04 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.187591 May 18 17:16:18.175394 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 422/856] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:17 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:19.196490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:19.197201 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:19.203585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:19.204042 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:19.204855 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:19.205318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:19.378012 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-368e47d7-8a41-491a-9e55-3cc262a6d842 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b11ad840-0ff3-40c7-80ea-afc5b158ff21"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:19.379211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-368e47d7-8a41-491a-9e55-3cc262a6d842 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:19.386191 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-368e47d7-8a41-491a-9e55-3cc262a6d842 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:19.386632 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-368e47d7-8a41-491a-9e55-3cc262a6d842 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:19.387447 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-368e47d7-8a41-491a-9e55-3cc262a6d842 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:19.387878 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-368e47d7-8a41-491a-9e55-3cc262a6d842 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:19.629405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:19.638207 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:19.640126 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:19.641294 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-335d3630-bfdf-4584-b3c8-d2b66af8b270 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.452020 May 18 17:16:19.641873 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 435/857] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:19 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:19.663277 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-368e47d7-8a41-491a-9e55-3cc262a6d842 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "POST /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289649 May 18 17:16:19.663897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 423/858] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:16:19 2022] POST /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:16:20.661088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:20.661628 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:20.664209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:20.669566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:20.670049 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:20.670826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:20.671264 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:20.808924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:20.816999 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:20.818523 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:20.819682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-162563a8-2597-4b19-94f9-6dc38fa70dde tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.163504 May 18 17:16:20.820248 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 436/859] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:20 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:21.838984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:21.839691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:21.841714 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:21.848018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:21.848475 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:21.849260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:21.849719 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:21.997379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:22.005566 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:22.007169 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:22.008324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f9cb2685-0985-4ab1-9b9c-df4a4adbb9bc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.174335 May 18 17:16:22.008886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 424/860] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:21 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:23.026291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:23.026905 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:23.033548 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:23.034157 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:23.035165 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:23.035357 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:23.166984 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:23.175786 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:23.177303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:23.178496 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-10cf0750-8887-4a05-a0ee-eda3af2a6b4d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.156162 May 18 17:16:23.179055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 437/861] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:23 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:24.197613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:24.198257 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:24.207914 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:24.208607 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:24.209408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:24.209899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:24.341405 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:24.351738 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:24.353255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:24.354566 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-af4f55ee-8bf8-4a4d-b539-147b8ba0688c tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1744 microversion: 2.20 time: 0.160934 May 18 17:16:24.355195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 425/862] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:24 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:25.372843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:25.373561 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:25.380550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:25.381042 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:25.381908 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:25.382350 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:25.513430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:25.522493 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:25.524003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:25.525156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0210840e-abdc-47f6-9604-cae4c4b703b8 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1744 microversion: 2.20 time: 0.156280 May 18 17:16:25.525734 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 438/863] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:25 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:25.724222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0768fcaf-55db-41b6-85d5-4feeca5e9aef tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:25.725224 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0768fcaf-55db-41b6-85d5-4feeca5e9aef tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:25.731294 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0768fcaf-55db-41b6-85d5-4feeca5e9aef tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:25.731775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0768fcaf-55db-41b6-85d5-4feeca5e9aef tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:25.732542 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0768fcaf-55db-41b6-85d5-4feeca5e9aef tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:25.732982 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0768fcaf-55db-41b6-85d5-4feeca5e9aef tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:25.762419 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0768fcaf-55db-41b6-85d5-4feeca5e9aef tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042949 May 18 17:16:25.762978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 426/864] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:16:25 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:25.774426 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d204e686-3860-41c7-8980-9868e39a96f3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:25.774857 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d204e686-3860-41c7-8980-9868e39a96f3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:25.780916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d204e686-3860-41c7-8980-9868e39a96f3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:25.781426 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d204e686-3860-41c7-8980-9868e39a96f3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:25.782319 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d204e686-3860-41c7-8980-9868e39a96f3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:25.782764 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d204e686-3860-41c7-8980-9868e39a96f3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:25.811436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d204e686-3860-41c7-8980-9868e39a96f3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/a536bbe1-f466-4928-b2e0-6bb2dddd9526" status: 200 len: 194 microversion: 2.1 time: 0.040978 May 18 17:16:25.812016 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 439/865] 10.222.0.49 () {58 vars in 1412 bytes} [Wed May 18 17:16:25 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/a536bbe1-f466-4928-b2e0-6bb2dddd9526 => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:26.154716 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-e0fff10d-0b09-46cd-a247-383560210202 req-d93377f2-abd9-486e-a1de-e49c4070e2fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53e5299-6ac2-4849-a4c1-01924709ff00", "name": "network-vif-plugged", "status": "completed", "tag": "47bc87df-78ea-4da7-8fdc-bd2bd4b75078"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:26.163421 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e0fff10d-0b09-46cd-a247-383560210202 req-d93377f2-abd9-486e-a1de-e49c4070e2fd service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:26.163865 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-e0fff10d-0b09-46cd-a247-383560210202 req-d93377f2-abd9-486e-a1de-e49c4070e2fd service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:26.176102 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-e0fff10d-0b09-46cd-a247-383560210202 req-d93377f2-abd9-486e-a1de-e49c4070e2fd service nova] Creating event network-vif-plugged:47bc87df-78ea-4da7-8fdc-bd2bd4b75078 for instance f53e5299-6ac2-4849-a4c1-01924709ff00 on hv-cinder-79578 May 18 17:16:26.181093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-e0fff10d-0b09-46cd-a247-383560210202 req-d93377f2-abd9-486e-a1de-e49c4070e2fd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030585 May 18 17:16:26.181821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 427/866] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:26.544323 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:26.544934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:26.553000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:26.553485 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:26.554365 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:26.554804 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:26.689956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:26.698097 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:26.699861 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:26.701606 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-491d805e-adad-4706-bb39-4ee1e61951cb tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1744 microversion: 2.20 time: 0.160830 May 18 17:16:26.701975 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 440/867] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:26 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:27.719877 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:27.724834 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:27.725539 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:27.732080 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:27.732531 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:27.733297 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:27.733767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:27.869306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:27.877829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:27.879316 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:27.880460 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a9bc2a68-ccec-4439-b260-710de7fe25cc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1744 microversion: 2.20 time: 0.162018 May 18 17:16:27.881025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 428/868] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:27 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:28.212516 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ad4a6429-1b8a-4772-a644-d47072f23115 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "468a7841-543c-43e4-8bb4-146c3d0fa8f3"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:28.213684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ad4a6429-1b8a-4772-a644-d47072f23115 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:28.221226 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ad4a6429-1b8a-4772-a644-d47072f23115 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:28.221787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ad4a6429-1b8a-4772-a644-d47072f23115 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:28.222567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ad4a6429-1b8a-4772-a644-d47072f23115 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:28.223006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ad4a6429-1b8a-4772-a644-d47072f23115 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:28.481322 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ad4a6429-1b8a-4772-a644-d47072f23115 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "POST /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272621 May 18 17:16:28.481986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 441/869] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:16:28 2022] POST /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:28.900560 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:28.901107 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:28.907583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:28.908035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:28.909305 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:28.909769 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:29.041392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:29.049997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:29.051498 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:29.052655 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8379df03-b0c3-482c-a020-a5c13382273d tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1744 microversion: 2.20 time: 0.156227 May 18 17:16:29.053212 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 429/870] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:28 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:16:30.072901 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:30.073602 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:30.079935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:30.080463 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:30.081237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:30.081689 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:30.085793 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:30.213113 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:30.222292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:30.223850 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:30.225094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f451da0c-ccca-4fce-a6fa-c76e31ac5a62 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1744 microversion: 2.20 time: 0.156943 May 18 17:16:30.225713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 442/871] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:30 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:16:31.243774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:31.244394 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:31.251048 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:31.251509 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:31.252802 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:31.253244 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:31.397934 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:31.405964 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:31.407470 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:31.409490 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f7b32bb6-b9c5-4ab1-a7e1-6b05933a719b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1744 microversion: 2.20 time: 0.169062 May 18 17:16:31.410011 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 430/872] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:31 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1744 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:32.428348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:32.430326 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:32.437131 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:32.437866 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:32.439003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:32.440536 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:32.602389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b85e39b3-9400-4c00-9ea3-b77085abd78a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:32.603122 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:32.603904 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b85e39b3-9400-4c00-9ea3-b77085abd78a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:32.612585 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:32.614192 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:32.616222 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7ca3f2fa-2221-46e5-9c5e-a1881990eaed tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.192633 May 18 17:16:32.617787 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 443/873] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:32 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:32.626623 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b85e39b3-9400-4c00-9ea3-b77085abd78a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:32.632008 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b85e39b3-9400-4c00-9ea3-b77085abd78a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:32.635038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b85e39b3-9400-4c00-9ea3-b77085abd78a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:32.636835 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b85e39b3-9400-4c00-9ea3-b77085abd78a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:32.845586 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b85e39b3-9400-4c00-9ea3-b77085abd78a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:32.860959 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b85e39b3-9400-4c00-9ea3-b77085abd78a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1592 microversion: 2.1 time: 0.263026 May 18 17:16:32.862218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 431/874] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:32 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1592 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:33.649164 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:33.650867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:33.659567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:33.660612 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:33.661907 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:33.662508 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:33.856948 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:33.879791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:33.881840 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:33.883685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-dbf40f09-40df-4bc7-9e6f-14bd238dd8a0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.239297 May 18 17:16:33.884249 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 444/875] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:33 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:34.903510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:34.905834 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:34.919187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:34.919996 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:34.923095 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:34.926620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:35.206763 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:35.218609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:35.220261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:35.221435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7de6c47e-837c-4e06-989e-14d7a2511b89 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.322272 May 18 17:16:35.222056 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 432/876] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:34 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:35.356339 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-33510961-1c9c-4d7d-a537-b4c9609d7641 req-4ddddc92-a35f-4e2b-bd5d-adbac60b406f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749c046f-33ee-458b-a080-584bdbc4549a", "tag": "83599677-1718-443a-b9f2-afbf3863f167"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:35.365776 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-33510961-1c9c-4d7d-a537-b4c9609d7641 req-4ddddc92-a35f-4e2b-bd5d-adbac60b406f service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:35.366484 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-33510961-1c9c-4d7d-a537-b4c9609d7641 req-4ddddc92-a35f-4e2b-bd5d-adbac60b406f service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:35.379275 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-33510961-1c9c-4d7d-a537-b4c9609d7641 req-4ddddc92-a35f-4e2b-bd5d-adbac60b406f service nova] Creating event network-changed:83599677-1718-443a-b9f2-afbf3863f167 for instance 749c046f-33ee-458b-a080-584bdbc4549a on hv-cinder-79578 May 18 17:16:35.385530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-33510961-1c9c-4d7d-a537-b4c9609d7641 req-4ddddc92-a35f-4e2b-bd5d-adbac60b406f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032627 May 18 17:16:35.386498 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 445/877] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:16:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:36.241805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:36.243083 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:36.253166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:36.254263 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:36.255573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:36.256212 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:36.290748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:36.556172 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:36.567041 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:36.569502 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:36.571066 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-59d22ed7-886b-44fb-b5c2-a2bf69515d3e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.335429 May 18 17:16:36.572422 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 433/878] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:36 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:36.834339 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5c4ebc1a-7217-4d43-a685-d6a822eba8a3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-332003399"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:36.834958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5c4ebc1a-7217-4d43-a685-d6a822eba8a3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:36.853818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c4ebc1a-7217-4d43-a685-d6a822eba8a3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:36.854269 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c4ebc1a-7217-4d43-a685-d6a822eba8a3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:36.855055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c4ebc1a-7217-4d43-a685-d6a822eba8a3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:36.855496 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5c4ebc1a-7217-4d43-a685-d6a822eba8a3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:37.023292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.network.security_group_api [None req-5c4ebc1a-7217-4d43-a685-d6a822eba8a3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Adding security group c67b20b0-285d-4882-9f8d-9b0b284118b7 to port 83599677-1718-443a-b9f2-afbf3863f167 May 18 17:16:37.535029 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5c4ebc1a-7217-4d43-a685-d6a822eba8a3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "POST /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/action" status: 202 len: 0 microversion: 2.1 time: 0.706125 May 18 17:16:37.537316 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 446/879] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:16:36 2022] POST /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 17:16:37.551652 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-c3574ea9-ae8b-41f1-b27b-a819619db77c req-3e2a64c6-b3c0-4a5b-8e08-a7373b8ed5aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749c046f-33ee-458b-a080-584bdbc4549a", "tag": "83599677-1718-443a-b9f2-afbf3863f167"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:37.558290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8eccdad0-bc2c-46ca-99fb-19538ae174bd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:37.559140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8eccdad0-bc2c-46ca-99fb-19538ae174bd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:37.590210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8eccdad0-bc2c-46ca-99fb-19538ae174bd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:37.590816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c3574ea9-ae8b-41f1-b27b-a819619db77c req-3e2a64c6-b3c0-4a5b-8e08-a7373b8ed5aa service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:37.591711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8eccdad0-bc2c-46ca-99fb-19538ae174bd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:37.596011 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-c3574ea9-ae8b-41f1-b27b-a819619db77c req-3e2a64c6-b3c0-4a5b-8e08-a7373b8ed5aa service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:37.597410 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8eccdad0-bc2c-46ca-99fb-19538ae174bd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:37.598738 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8eccdad0-bc2c-46ca-99fb-19538ae174bd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:37.630717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-c3574ea9-ae8b-41f1-b27b-a819619db77c req-3e2a64c6-b3c0-4a5b-8e08-a7373b8ed5aa service nova] Creating event network-changed:83599677-1718-443a-b9f2-afbf3863f167 for instance 749c046f-33ee-458b-a080-584bdbc4549a on hv-cinder-79578 May 18 17:16:37.644826 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-c3574ea9-ae8b-41f1-b27b-a819619db77c req-3e2a64c6-b3c0-4a5b-8e08-a7373b8ed5aa service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102902 May 18 17:16:37.647800 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 434/880] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:37.664624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:37.665692 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:37.678806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:37.681336 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:37.682602 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:37.683331 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:37.897075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8eccdad0-bc2c-46ca-99fb-19538ae174bd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:37.912645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8eccdad0-bc2c-46ca-99fb-19538ae174bd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1757 microversion: 2.1 time: 0.366143 May 18 17:16:37.913687 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 447/881] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:37 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1757 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:37.946582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:37.965464 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:37.969495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:37.972006 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d4d8123d-3e31-4404-b6bf-d15310247991 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.319115 May 18 17:16:37.973854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 435/882] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:37 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:39.004957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:39.005569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:39.014003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:39.014450 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:39.015226 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:39.015658 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:39.198594 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:39.208242 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:39.210469 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:39.212095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4bdd0f54-ed37-4cfe-9303-e71dc6e4e4de tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.212191 May 18 17:16:39.213159 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 448/883] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:38 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:40.243709 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:40.244969 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:40.252238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:40.252946 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:40.254457 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:40.254899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:40.401602 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:40.410095 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:40.412799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:40.417468 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-030be307-393d-476d-8403-16fd5433ce44 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.177709 May 18 17:16:40.418919 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 436/884] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:40 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:40.504493 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c8d111ad-41eb-4724-8799-1075c6cb743a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:40.505901 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c8d111ad-41eb-4724-8799-1075c6cb743a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:40.513336 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8d111ad-41eb-4724-8799-1075c6cb743a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:40.513896 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8d111ad-41eb-4724-8799-1075c6cb743a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:40.514738 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8d111ad-41eb-4724-8799-1075c6cb743a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:40.515520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c8d111ad-41eb-4724-8799-1075c6cb743a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:40.547899 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c8d111ad-41eb-4724-8799-1075c6cb743a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047452 May 18 17:16:40.549248 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 449/885] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:16:40 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:40.690912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ba2a1c75-c2d9-485b-a42b-d5ea2f93d0f6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:40.692219 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ba2a1c75-c2d9-485b-a42b-d5ea2f93d0f6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:40.699803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba2a1c75-c2d9-485b-a42b-d5ea2f93d0f6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:40.700320 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba2a1c75-c2d9-485b-a42b-d5ea2f93d0f6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:40.701351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba2a1c75-c2d9-485b-a42b-d5ea2f93d0f6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:40.701816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ba2a1c75-c2d9-485b-a42b-d5ea2f93d0f6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:40.738626 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ba2a1c75-c2d9-485b-a42b-d5ea2f93d0f6 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/a536bbe1-f466-4928-b2e0-6bb2dddd9526" status: 200 len: 194 microversion: 2.1 time: 0.053066 May 18 17:16:40.739271 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 437/886] 10.222.0.49 () {58 vars in 1412 bytes} [Wed May 18 17:16:40 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/a536bbe1-f466-4928-b2e0-6bb2dddd9526 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:40.748774 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b255870b-3b79-471a-ab8e-5e30e489aba1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:40.749751 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b255870b-3b79-471a-ab8e-5e30e489aba1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:40.757016 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b255870b-3b79-471a-ab8e-5e30e489aba1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:40.757468 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b255870b-3b79-471a-ab8e-5e30e489aba1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:40.758291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b255870b-3b79-471a-ab8e-5e30e489aba1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:40.758938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b255870b-3b79-471a-ab8e-5e30e489aba1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:40.854143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-b255870b-3b79-471a-ab8e-5e30e489aba1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lazy-loading 'services' on Instance uuid 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:16:40.930633 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b255870b-3b79-471a-ab8e-5e30e489aba1 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/a536bbe1-f466-4928-b2e0-6bb2dddd9526" status: 202 len: 0 microversion: 2.1 time: 0.185593 May 18 17:16:40.931463 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 450/887] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:16:40 2022] DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/a536bbe1-f466-4928-b2e0-6bb2dddd9526 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:16:41.440656 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:41.440656 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:41.446377 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:41.447073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:41.447844 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:41.448467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:41.604386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:41.613761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:41.615250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:41.616485 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-92c06c01-7841-4775-9702-63cf3bf6bd6e tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.184163 May 18 17:16:41.617036 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 438/888] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:41 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:42.636009 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:42.636743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:42.643985 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:42.644496 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:42.645291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:42.645738 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:42.804584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:42.813560 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:42.815785 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:42.817212 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d4f2b1db-21d7-4e0c-95cf-2f23eb39da1f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.186291 May 18 17:16:42.826025 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 451/889] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:42 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:43.128985 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a46830a2-be63-49d3-a07b-89bb3d3a6a5f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:43.129552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-a46830a2-be63-49d3-a07b-89bb3d3a6a5f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:43.137749 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a46830a2-be63-49d3-a07b-89bb3d3a6a5f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:43.138230 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a46830a2-be63-49d3-a07b-89bb3d3a6a5f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:43.138974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a46830a2-be63-49d3-a07b-89bb3d3a6a5f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:43.139413 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-a46830a2-be63-49d3-a07b-89bb3d3a6a5f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:43.172726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a46830a2-be63-49d3-a07b-89bb3d3a6a5f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/468a7841-543c-43e4-8bb4-146c3d0fa8f3" status: 200 len: 194 microversion: 2.1 time: 0.048226 May 18 17:16:43.173326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 439/890] 10.222.0.49 () {58 vars in 1412 bytes} [Wed May 18 17:16:43 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/468a7841-543c-43e4-8bb4-146c3d0fa8f3 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:43.184065 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-51519e0a-1105-4843-bb62-b7e21c67a036 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:43.184807 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-51519e0a-1105-4843-bb62-b7e21c67a036 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:43.193858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-51519e0a-1105-4843-bb62-b7e21c67a036 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:43.194603 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-51519e0a-1105-4843-bb62-b7e21c67a036 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:43.195527 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-51519e0a-1105-4843-bb62-b7e21c67a036 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:43.196162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-51519e0a-1105-4843-bb62-b7e21c67a036 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:43.284292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-51519e0a-1105-4843-bb62-b7e21c67a036 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lazy-loading 'services' on Instance uuid 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:16:43.360095 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-51519e0a-1105-4843-bb62-b7e21c67a036 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/468a7841-543c-43e4-8bb4-146c3d0fa8f3" status: 202 len: 0 microversion: 2.1 time: 0.180475 May 18 17:16:43.360853 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 452/891] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:16:43 2022] DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments/468a7841-543c-43e4-8bb4-146c3d0fa8f3 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:16:43.835754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:43.836365 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:43.843048 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:43.843498 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:43.844283 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:43.844727 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:43.982601 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:43.991530 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:43.993047 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:43.994293 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f69ec944-2f49-44af-9bf3-a481729aba71 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1739 microversion: 2.20 time: 0.162496 May 18 17:16:43.994852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 440/892] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:43 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:45.014339 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:45.015324 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:45.023800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.024272 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.025059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.025514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.174898 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:45.183477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:45.185007 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:45.186236 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-33358f01-416b-4fda-b35d-b6cccd5bbec9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1721 microversion: 2.20 time: 0.177224 May 18 17:16:45.186803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 453/893] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:45 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:45.590530 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-51ab2185-c0a5-4194-8281-3c86bd602b6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:45.591467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-51ab2185-c0a5-4194-8281-3c86bd602b6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:45.598378 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51ab2185-c0a5-4194-8281-3c86bd602b6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.598823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51ab2185-c0a5-4194-8281-3c86bd602b6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.599586 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51ab2185-c0a5-4194-8281-3c86bd602b6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.600016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-51ab2185-c0a5-4194-8281-3c86bd602b6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.629090 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-51ab2185-c0a5-4194-8281-3c86bd602b6f tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042633 May 18 17:16:45.629645 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 441/894] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:16:45 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 17:16:45.740902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-34754914-fea9-445f-818a-087bdd4ca7c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:45.741857 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-34754914-fea9-445f-818a-087bdd4ca7c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:45.747859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-34754914-fea9-445f-818a-087bdd4ca7c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.748307 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-34754914-fea9-445f-818a-087bdd4ca7c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.749067 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-34754914-fea9-445f-818a-087bdd4ca7c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.749499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-34754914-fea9-445f-818a-087bdd4ca7c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.779237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-34754914-fea9-445f-818a-087bdd4ca7c4 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042984 May 18 17:16:45.779786 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 454/895] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:16:45 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 18 17:16:45.837019 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1f27acd7-9d10-45de-a1f0-a1fee60a4898 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:45.837523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1f27acd7-9d10-45de-a1f0-a1fee60a4898 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:45.843919 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f27acd7-9d10-45de-a1f0-a1fee60a4898 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.844380 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f27acd7-9d10-45de-a1f0-a1fee60a4898 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.845148 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f27acd7-9d10-45de-a1f0-a1fee60a4898 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.845592 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f27acd7-9d10-45de-a1f0-a1fee60a4898 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.870968 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1f27acd7-9d10-45de-a1f0-a1fee60a4898 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:16:45.946693 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1f27acd7-9d10-45de-a1f0-a1fee60a4898 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 204 len: 0 microversion: 2.1 time: 0.112797 May 18 17:16:45.947404 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 442/896] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:16:45 2022] DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:16:45.956990 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9d37b34e-824c-492b-8493-140485e0bdb3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:45.957638 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9d37b34e-824c-492b-8493-140485e0bdb3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:45.963821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9d37b34e-824c-492b-8493-140485e0bdb3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.964277 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9d37b34e-824c-492b-8493-140485e0bdb3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:45.965046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9d37b34e-824c-492b-8493-140485e0bdb3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:45.965487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9d37b34e-824c-492b-8493-140485e0bdb3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:46.095161 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-9d37b34e-824c-492b-8493-140485e0bdb3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:46.103842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9d37b34e-824c-492b-8493-140485e0bdb3 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1671 microversion: 2.1 time: 0.151274 May 18 17:16:46.104415 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 455/897] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:45 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:46.205575 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:46.206322 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:46.212342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:46.212794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:46.213557 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:46.214018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:46.356179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:46.365329 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:46.367015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:46.368199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ef19dd28-c7c1-4166-9801-bf2b7dc4ea32 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1721 microversion: 2.20 time: 0.167134 May 18 17:16:46.368761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 443/898] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:46 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:47.122072 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7e417ade-5802-44d8-9214-bd576060b6d0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:47.122692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7e417ade-5802-44d8-9214-bd576060b6d0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:47.130936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7e417ade-5802-44d8-9214-bd576060b6d0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:47.131394 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7e417ade-5802-44d8-9214-bd576060b6d0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:47.132213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7e417ade-5802-44d8-9214-bd576060b6d0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:47.132651 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7e417ade-5802-44d8-9214-bd576060b6d0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:47.276822 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7e417ade-5802-44d8-9214-bd576060b6d0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:47.284435 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7e417ade-5802-44d8-9214-bd576060b6d0 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1671 microversion: 2.1 time: 0.166197 May 18 17:16:47.285000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 456/899] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:47 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:47.389743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:47.390922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:47.401876 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:47.402468 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:47.403737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:47.404535 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:47.544591 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:47.553487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:47.555004 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:47.556237 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cbf5258b-93df-4521-8493-67e3ad584784 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1721 microversion: 2.20 time: 0.172493 May 18 17:16:47.556804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 444/900] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:47 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:48.205156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-6c716c81-998a-4010-8aac-ee32943f53f5 req-7830aca6-764c-4377-b53a-338b08c20789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53e5299-6ac2-4849-a4c1-01924709ff00", "name": "network-vif-unplugged", "status": "completed", "tag": "47bc87df-78ea-4da7-8fdc-bd2bd4b75078"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:48.215098 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-6c716c81-998a-4010-8aac-ee32943f53f5 req-7830aca6-764c-4377-b53a-338b08c20789 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:48.215548 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-6c716c81-998a-4010-8aac-ee32943f53f5 req-7830aca6-764c-4377-b53a-338b08c20789 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:48.227994 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-6c716c81-998a-4010-8aac-ee32943f53f5 req-7830aca6-764c-4377-b53a-338b08c20789 service nova] Creating event network-vif-unplugged:47bc87df-78ea-4da7-8fdc-bd2bd4b75078 for instance f53e5299-6ac2-4849-a4c1-01924709ff00 on hv-cinder-79578 May 18 17:16:48.233526 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-6c716c81-998a-4010-8aac-ee32943f53f5 req-7830aca6-764c-4377-b53a-338b08c20789 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032038 May 18 17:16:48.234231 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 457/901] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:16:48.301504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f5de3066-de14-40ae-9c45-6ad33eaed2cf tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:48.302146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f5de3066-de14-40ae-9c45-6ad33eaed2cf tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:48.308198 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f5de3066-de14-40ae-9c45-6ad33eaed2cf tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:48.308646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f5de3066-de14-40ae-9c45-6ad33eaed2cf tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:48.309401 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f5de3066-de14-40ae-9c45-6ad33eaed2cf tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:48.309861 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f5de3066-de14-40ae-9c45-6ad33eaed2cf tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:48.449333 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f5de3066-de14-40ae-9c45-6ad33eaed2cf tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:48.458575 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f5de3066-de14-40ae-9c45-6ad33eaed2cf tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1671 microversion: 2.1 time: 0.160849 May 18 17:16:48.459256 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 445/902] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:48 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1671 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:48.574535 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:48.575154 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:48.582379 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:48.582832 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:48.583644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:48.584083 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:48.716093 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:48.724466 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:48.725995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:48.727270 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02d7b3fe-be3c-47e0-a424-b19760b4f272 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1724 microversion: 2.20 time: 0.156953 May 18 17:16:48.727910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 458/903] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:48 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:48.746583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-36591b8f-a0d1-4a85-a027-601c61abeda7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4fb910a-4c0d-46d9-87f0-788d7911d560"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:48.747718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-36591b8f-a0d1-4a85-a027-601c61abeda7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:48.757868 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36591b8f-a0d1-4a85-a027-601c61abeda7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:48.758324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36591b8f-a0d1-4a85-a027-601c61abeda7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:48.759113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36591b8f-a0d1-4a85-a027-601c61abeda7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:48.759551 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-36591b8f-a0d1-4a85-a027-601c61abeda7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:49.031749 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:49.046932 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-36591b8f-a0d1-4a85-a027-601c61abeda7 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.304378 May 18 17:16:49.047545 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 446/904] 10.222.0.49 () {62 vars in 1363 bytes} [Wed May 18 17:16:48 2022] POST /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/os-volume_attachments => generated 188 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 18 17:16:49.168165 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cbce7ca1-f4d6-46df-9d27-46e8a3b746ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:49.168674 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cbce7ca1-f4d6-46df-9d27-46e8a3b746ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:49.175829 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbce7ca1-f4d6-46df-9d27-46e8a3b746ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:49.176283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbce7ca1-f4d6-46df-9d27-46e8a3b746ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:49.177059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbce7ca1-f4d6-46df-9d27-46e8a3b746ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:49.177496 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cbce7ca1-f4d6-46df-9d27-46e8a3b746ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:49.181775 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:49.436499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cbce7ca1-f4d6-46df-9d27-46e8a3b746ff tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/os-volume_attachments/b4fb910a-4c0d-46d9-87f0-788d7911d560" status: 202 len: 0 microversion: 2.20 time: 0.272224 May 18 17:16:49.437514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 459/905] 10.222.0.49 () {60 vars in 1456 bytes} [Wed May 18 17:16:49 2022] DELETE /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/os-volume_attachments/b4fb910a-4c0d-46d9-87f0-788d7911d560 => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 18 17:16:49.477345 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-804a774f-85a0-4b4f-b66f-a4b703bb80ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:49.478079 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-804a774f-85a0-4b4f-b66f-a4b703bb80ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:49.488149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-804a774f-85a0-4b4f-b66f-a4b703bb80ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:49.488149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-804a774f-85a0-4b4f-b66f-a4b703bb80ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:49.488149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-804a774f-85a0-4b4f-b66f-a4b703bb80ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:49.488149 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-804a774f-85a0-4b4f-b66f-a4b703bb80ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:49.494087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-67267487-1aa1-4bed-9950-9bbe0a426bab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:49.494663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-67267487-1aa1-4bed-9950-9bbe0a426bab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:49.503834 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67267487-1aa1-4bed-9950-9bbe0a426bab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:49.504300 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67267487-1aa1-4bed-9950-9bbe0a426bab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:49.505087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67267487-1aa1-4bed-9950-9bbe0a426bab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:49.505523 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-67267487-1aa1-4bed-9950-9bbe0a426bab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:49.731803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-804a774f-85a0-4b4f-b66f-a4b703bb80ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:49.740866 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-804a774f-85a0-4b4f-b66f-a4b703bb80ba tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1671 microversion: 2.1 time: 0.267739 May 18 17:16:49.741912 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 447/906] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:49 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1671 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:49.754604 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-67267487-1aa1-4bed-9950-9bbe0a426bab tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "POST /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/action" status: 202 len: 0 microversion: 2.20 time: 0.264414 May 18 17:16:49.758361 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 460/907] 10.222.0.49 () {62 vars in 1318 bytes} [Wed May 18 17:16:49 2022] POST /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 18 17:16:49.764103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:49.764797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:49.771342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:49.772002 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:49.772760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:49.773273 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:50.348746 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:50.357299 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:50.358932 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:50.360244 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-092c1278-2281-4286-9c2b-e860e3cae6ce tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1672 microversion: 2.20 time: 0.600664 May 18 17:16:50.360974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 448/908] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:49 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1672 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:50.624735 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-975444be-bbc1-4546-b33c-fbb6c6fe01f5 req-e9782eb4-e208-45d4-9101-9de935e55975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "477c2c87-8a2c-4acf-ba33-221f1ac3b4d6", "name": "network-vif-deleted", "tag": "d73ff1bd-c125-4c71-88a9-127b38c3ce37"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:16:50.638780 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-975444be-bbc1-4546-b33c-fbb6c6fe01f5 req-e9782eb4-e208-45d4-9101-9de935e55975 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:50.639368 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-975444be-bbc1-4546-b33c-fbb6c6fe01f5 req-e9782eb4-e208-45d4-9101-9de935e55975 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:50.652515 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-975444be-bbc1-4546-b33c-fbb6c6fe01f5 req-e9782eb4-e208-45d4-9101-9de935e55975 service nova] Creating event network-vif-deleted:d73ff1bd-c125-4c71-88a9-127b38c3ce37 for instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 on hv-cinder-79578 May 18 17:16:50.677443 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-975444be-bbc1-4546-b33c-fbb6c6fe01f5 req-e9782eb4-e208-45d4-9101-9de935e55975 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053394 May 18 17:16:50.678672 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 461/909] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:16:50.765455 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:50.766166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:50.773268 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:50.773818 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:50.775023 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:50.775682 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:50.826013 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:50.826459 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:50.827077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lazy-loading 'fault' on Instance uuid 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:16:50.886758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b596d7285294117b826f459a39872c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ffb442f11714159af838b0176f885ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:50.901027 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d3e5fb40-e39f-42d1-a04b-e35744da8b17 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 200 len: 1326 microversion: 2.1 time: 0.140598 May 18 17:16:50.903146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 449/910] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:50 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 1326 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:16:51.388957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:51.389782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:51.391805 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=54 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:51.398851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:51.399347 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:51.400143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:51.400583 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:51.559643 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:51.570768 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:51.572390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:51.573602 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-04e8d642-6c80-48e4-b66f-e8ead2c83cec tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.188926 May 18 17:16:51.588517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 462/911] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:51 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:51.923804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:51.924496 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:51.927016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:16:51.932495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:51.932954 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:51.933910 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:51.934369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:51.950700 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] HTTP exception thrown: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Request method failure captured: May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 HTTP/1.1 May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd-EChBzKkiz01fh5jHwWcg3De8TtR_bwgFKRgJ9jgnRpCvL8vCsldgI7ECTbC6s4SzKdtu89TTMMCZ3geYGDCDJXt-0drUJhR5xipkMvIh0RrfwWJk9aLM_732FJdhVaQVwxp539hbVKjP4wuHLVKT1RlOXHRo0dyIpk2JVwHam-Q May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:16:51.952547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2ffb442f11714159af838b0176f885ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2ffb442f11714159af838b0176f885ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 9b596d7285294117b826f459a39872c1 May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:51.956129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '477c2c87-8a2c-4acf-ba33-221f1ac3b4d6'} May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:16:51.956997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:51.958313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:51.959423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Returning 404 to user: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:16:51.959423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7e8646ef-14cb-49b3-a631-83117d3c60e9 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 404 len: 111 microversion: 2.1 time: 0.034522 May 18 17:16:51.959423 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 450/912] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:51 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:16:51.963944 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-40b53d2b-c1c1-4cbf-8cd1-5ec3a064d035 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '.version_select at 0x7feef3a68160>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:51.983221 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-40b53d2b-c1c1-4cbf-8cd1-5ec3a064d035 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-662542631" status: 202 len: 0 microversion: 2.1 time: 0.023067 May 18 17:16:51.983946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 463/913] 10.222.0.49 () {58 vars in 1217 bytes} [Wed May 18 17:16:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-662542631 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 17:16:52.597455 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:52.598105 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:52.604748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:52.605227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:52.606047 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:52.606491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:52.891817 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:52.907075 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:52.910895 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:52.912448 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c4febb26-2455-4fe8-9dde-ca564ed2f192 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.320727 May 18 17:16:52.913736 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 451/914] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:52 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:53.932821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:53.933428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:53.940048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:53.940503 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:53.941439 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:53.941907 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:54.093035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:54.102987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:54.104688 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:54.105912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-55bc0b17-d8a5-4857-b7e4-4ec0a894fe42 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.177496 May 18 17:16:54.117291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 464/915] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:53 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:55.124847 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:55.125453 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:55.132204 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:55.132904 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:55.133022 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:55.133452 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:55.134427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:55.135016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:55.140182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:55.140598 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:55.141452 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:55.142019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:55.165820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] HTTP exception thrown: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Request method failure captured: May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 HTTP/1.1 May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd-EChBzKkiz01fh5jHwWcg3De8TtR_bwgFKRgJ9jgnRpCvL8vCsldgI7ECTbC6s4SzKdtu89TTMMCZ3geYGDCDJXt-0drUJhR5xipkMvIh0RrfwWJk9aLM_732FJdhVaQVwxp539hbVKjP4wuHLVKT1RlOXHRo0dyIpk2JVwHam-Q May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:16:55.167490 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2ffb442f11714159af838b0176f885ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2ffb442f11714159af838b0176f885ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 9b596d7285294117b826f459a39872c1 May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.169104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '477c2c87-8a2c-4acf-ba33-221f1ac3b4d6'} May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:16:55.169958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.171413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.172935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Returning 404 to user: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:16:55.172935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b9ee3ca3-42aa-49d3-b3ae-4c71d1ae976a tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 404 len: 111 microversion: 2.1 time: 0.040627 May 18 17:16:55.172935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 465/916] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:16:55 2022] DELETE /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 17:16:55.177948 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:55.178559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:55.184991 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:55.185438 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:55.186238 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:55.186684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:55.203435 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] HTTP exception thrown: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Request method failure captured: May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 HTTP/1.1 May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd-EChBzKkiz01fh5jHwWcg3De8TtR_bwgFKRgJ9jgnRpCvL8vCsldgI7ECTbC6s4SzKdtu89TTMMCZ3geYGDCDJXt-0drUJhR5xipkMvIh0RrfwWJk9aLM_732FJdhVaQVwxp539hbVKjP4wuHLVKT1RlOXHRo0dyIpk2JVwHam-Q May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:16:55.205881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2ffb442f11714159af838b0176f885ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2ffb442f11714159af838b0176f885ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 9b596d7285294117b826f459a39872c1 May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.207582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '477c2c87-8a2c-4acf-ba33-221f1ac3b4d6'} May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:16:55.208513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. May 18 17:16:55.209924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:55.211179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Returning 404 to user: Instance 477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:16:55.213451 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4f9e50d0-3317-4949-bf46-2b124f9ee5ed tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6" status: 404 len: 111 microversion: 2.1 time: 0.035508 May 18 17:16:55.214111 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 466/917] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:55 2022] GET /compute/v2.1/servers/477c2c87-8a2c-4acf-ba33-221f1ac3b4d6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 17:16:55.287563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:55.296199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:55.298007 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:55.300265 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b807436d-5fc7-4305-870f-2703ddbe66f9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.179487 May 18 17:16:55.301150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 452/918] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:55 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:56.318814 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:56.319478 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:56.326220 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:56.326567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:56.327383 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:56.327823 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:56.492157 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:56.500822 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:56.502654 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:56.503888 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ba5019ce-4980-4240-b2fb-6ba53352c68b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.189227 May 18 17:16:56.504453 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 467/919] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:56 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:16:56.713920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:56.714772 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:56.725444 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:56.726116 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:56.727182 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:56.727717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:56.749926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] HTTP exception thrown: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Request method failure captured: May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: DELETE /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 HTTP/1.1 May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd-EChBzKkiz01fh5jHwWcg3De8TtR_bwgFKRgJ9jgnRpCvL8vCsldgI7ECTbC6s4SzKdtu89TTMMCZ3geYGDCDJXt-0drUJhR5xipkMvIh0RrfwWJk9aLM_732FJdhVaQVwxp539hbVKjP4wuHLVKT1RlOXHRo0dyIpk2JVwHam-Q May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:16:56.753563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2ffb442f11714159af838b0176f885ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2ffb442f11714159af838b0176f885ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 9b596d7285294117b826f459a39872c1 May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.755272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '457f8f5f-ff7d-4484-8e29-298c7ecbee76'} May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:16:56.756160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.764435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:16:56.767353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Returning 404 to user: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:16:56.767353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3bb6d254-aa27-4e43-8fec-3efed53c5e69 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "DELETE /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 404 len: 111 microversion: 2.1 time: 0.049008 May 18 17:16:56.767353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 453/920] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:16:56 2022] DELETE /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 18 17:16:56.767784 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:56.767784 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] [instance: 457f8f5f-ff7d-4484-8e29-298c7ecbee76] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:56.781387 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:56.782087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:56.783376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:56.783896 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:56.802006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] HTTP exception thrown: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Request method failure captured: May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 HTTP/1.1 May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd-EChBzKkiz01fh5jHwWcg3De8TtR_bwgFKRgJ9jgnRpCvL8vCsldgI7ECTbC6s4SzKdtu89TTMMCZ3geYGDCDJXt-0drUJhR5xipkMvIh0RrfwWJk9aLM_732FJdhVaQVwxp539hbVKjP4wuHLVKT1RlOXHRo0dyIpk2JVwHam-Q May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:16:56.804227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_2ffb442f11714159af838b0176f885ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/2ffb442f11714159af838b0176f885ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/2ffb442f11714159af838b0176f885ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 2ffb442f11714159af838b0176f885ca May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeTestJSON-318183275 May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 9b596d7285294117b826f459a39872c1 May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeTestJSON-318183275-project May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.806213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '457f8f5f-ff7d-4484-8e29-298c7ecbee76'} May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:16:56.807237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. May 18 17:16:56.808578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:16:56.809957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] Returning 404 to user: Instance 457f8f5f-ff7d-4484-8e29-298c7ecbee76 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:16:56.809957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c74e5805-c260-46db-9896-c495bb500e52 tempest-AttachVolumeTestJSON-318183275 tempest-AttachVolumeTestJSON-318183275-project] 10.222.0.49 "GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76" status: 404 len: 111 microversion: 2.1 time: 0.043396 May 18 17:16:56.809957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 468/921] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:16:56 2022] GET /compute/v2.1/servers/457f8f5f-ff7d-4484-8e29-298c7ecbee76 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:16:57.523851 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:57.524652 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:57.531300 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:57.531802 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:57.532673 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:57.534421 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:57.708685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:57.723318 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:57.724974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:57.726210 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-44b56e54-e68f-40f9-ad27-112f7442b625 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.206520 May 18 17:16:57.726765 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 454/922] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:57 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:16:58.746819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:16:58.748381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:16:58.756924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:58.757404 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:58.758502 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:16:58.759208 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:16:59.418038 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:59.433098 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:59.434722 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:16:59.441477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-25d4c2b4-2281-4556-86ae-5ee0bedd7a69 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.695100 May 18 17:16:59.443862 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 469/923] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:16:58 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:00.460880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:00.462289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:00.469842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:00.470669 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:00.471733 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:00.472402 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:00.695742 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:00.709902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:00.715329 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:00.721543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-496c845d-9ced-4006-ae72-fcaab6e9b635 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.260654 May 18 17:17:00.722658 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 455/924] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:00 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:01.752674 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:01.753295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:01.763989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:01.764442 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:01.765767 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:01.765767 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:02.031478 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:02.050286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:02.055876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:02.057930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a6c8c06e-df25-4928-b8c4-8206245a4736 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.310619 May 18 17:17:02.071700 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 470/925] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:01 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:03.076926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:03.077554 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:03.085265 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:03.085748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:03.086532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:03.087005 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:03.229115 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:03.237914 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:03.239431 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:03.240604 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f8b4c1ba-270a-4d5d-961d-c4b7d597fe20 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.167757 May 18 17:17:03.241177 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 456/926] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:03 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:04.259970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:04.260575 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:04.268310 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:04.268793 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:04.269578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:04.270046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:04.401892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:04.410158 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:04.411722 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:04.412909 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8b430c4c-30e6-4859-b8d7-2c3ba82ec911 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.157100 May 18 17:17:04.413458 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 471/927] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:04 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:05.430275 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:05.430891 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:05.437450 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:05.437941 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:05.439213 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:05.439879 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:05.569458 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:05.577349 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:05.578875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:05.580227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4b3c28c8-34a5-471b-84f5-61845eb3e52b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.153916 May 18 17:17:05.580774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 457/928] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:05 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:06.600978 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:06.607703 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:06.614851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:06.615305 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:06.616074 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:06.616513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:06.747678 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:06.756771 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:06.758310 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:06.759479 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3c1ddf89-dea7-41b7-b62e-3804954b8952 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.163638 May 18 17:17:06.760035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 472/929] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:06 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:07.778257 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:07.778918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:07.786584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:07.787096 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:07.787924 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:07.788439 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:07.957027 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:07.964943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:07.966603 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:07.968020 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-74914edf-2175-4226-af4f-34e91aae10f2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.193714 May 18 17:17:07.968592 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 458/930] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:07 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:08.988606 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:08.989242 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:08.996283 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:08.996747 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:08.997533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:08.998019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:09.142520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:09.150645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:09.152138 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:09.153302 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d37fb385-faae-49c6-b610-e7a371404d72 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.170135 May 18 17:17:09.153883 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 473/931] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:08 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:10.171668 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:10.172276 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:10.181243 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:10.181708 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:10.182493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:10.182922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:10.328699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:10.344784 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:10.349129 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:10.351490 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4f05f96b-fc8b-4852-a31a-992dc299d581 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.183404 May 18 17:17:10.352552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 459/932] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:10 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:11.378720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:11.379270 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:11.386064 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:11.386623 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:11.387395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:11.387833 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:11.523805 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:11.531624 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:11.534550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:11.535711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a178e281-5e99-41e8-8f32-2f2f79a30a29 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.161641 May 18 17:17:11.536259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 474/933] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:11 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:12.554685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:12.555392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:12.562374 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:12.562837 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:12.563652 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:12.564088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:12.696839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:12.707098 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:12.708717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:12.709920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0bff2218-d8fa-4efd-af04-d09445207dbc tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.159217 May 18 17:17:12.710494 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 460/934] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:12 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:13.729917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:13.730613 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:13.738918 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:13.739425 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:13.740260 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:13.740744 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:13.879737 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:13.887721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:13.889223 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:13.890401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-14bc3e63-24d8-48a9-938b-9c93f6923003 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.164945 May 18 17:17:13.890950 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 475/935] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:13 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:14.909876 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:14.910493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:14.916942 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:14.917396 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:14.918202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:14.918647 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:15.057696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:15.070287 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:15.071318 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:15.072731 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4f138b24-27b9-4d32-af86-29f60cb6a0e2 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.167253 May 18 17:17:15.073791 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 461/936] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:14 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:16.093168 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:16.093926 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:16.101928 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:16.102381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:16.103311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:16.103761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:16.108609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:16.302912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:16.311860 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:16.313789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:16.315521 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a966fd0b-9c6a-44b6-bb70-6b2493ef6742 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.226547 May 18 17:17:16.326638 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 476/937] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:16 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:16.518884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-a0969849-d45f-4ee9-a755-651b0eb7bb70 req-db2790f6-4fb1-4a25-9902-d9adfe1b209b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53e5299-6ac2-4849-a4c1-01924709ff00", "name": "network-vif-plugged", "status": "completed", "tag": "47bc87df-78ea-4da7-8fdc-bd2bd4b75078"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:17:16.527308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-a0969849-d45f-4ee9-a755-651b0eb7bb70 req-db2790f6-4fb1-4a25-9902-d9adfe1b209b service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:16.527764 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-a0969849-d45f-4ee9-a755-651b0eb7bb70 req-db2790f6-4fb1-4a25-9902-d9adfe1b209b service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:16.540543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-a0969849-d45f-4ee9-a755-651b0eb7bb70 req-db2790f6-4fb1-4a25-9902-d9adfe1b209b service nova] Creating event network-vif-plugged:47bc87df-78ea-4da7-8fdc-bd2bd4b75078 for instance f53e5299-6ac2-4849-a4c1-01924709ff00 on hv-cinder-79578 May 18 17:17:16.545546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-a0969849-d45f-4ee9-a755-651b0eb7bb70 req-db2790f6-4fb1-4a25-9902-d9adfe1b209b service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188068 May 18 17:17:16.546231 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 462/938] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:17:17.335094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:17.335827 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:17.343078 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:17.343573 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:17.344506 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:17.345817 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:17.482132 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:17.491893 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:17.493407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:17.494615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7c8da507-db20-4241-a4a5-19fc2ee8d07b tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.163693 May 18 17:17:17.495212 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 477/939] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:17 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:18.516134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:18.517391 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:18.524184 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:18.524820 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:18.525637 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:18.526327 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:18.686583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:18.698706 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:18.700523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:18.701873 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b4019390-27f5-4ddb-8681-0a7006bcc5d0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1730 microversion: 2.20 time: 0.190922 May 18 17:17:18.702507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 463/940] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:18 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:19.722789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:19.723473 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:19.730026 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:19.730472 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:19.731311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:19.731672 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:19.867818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:19.877112 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:19.878533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:19.879733 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-93f2e7a2-f689-446e-8ddd-5e5f0f9b6414 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1717 microversion: 2.20 time: 0.162187 May 18 17:17:19.880286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 478/941] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:17:19 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:17:25.282594 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2f877086-d476-4e6a-b72f-8f7e6981ad63 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:25.283141 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2f877086-d476-4e6a-b72f-8f7e6981ad63 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:25.285434 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=28 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:25.290926 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2f877086-d476-4e6a-b72f-8f7e6981ad63 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:25.291380 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2f877086-d476-4e6a-b72f-8f7e6981ad63 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:25.292155 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2f877086-d476-4e6a-b72f-8f7e6981ad63 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:25.292590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2f877086-d476-4e6a-b72f-8f7e6981ad63 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:25.295222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:25.318128 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2f877086-d476-4e6a-b72f-8f7e6981ad63 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/ips" status: 200 len: 148 microversion: 2.1 time: 0.039678 May 18 17:17:25.318697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 464/942] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:17:25 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/ips => generated 148 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:17:27.700660 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f8a8dd2a-fd71-4ba6-b4fe-c5fec988cc1d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "db008606-913c-4310-bd66-a92a788334d4"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:17:27.701750 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f8a8dd2a-fd71-4ba6-b4fe-c5fec988cc1d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:27.705559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:27.712367 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f8a8dd2a-fd71-4ba6-b4fe-c5fec988cc1d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:27.712851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f8a8dd2a-fd71-4ba6-b4fe-c5fec988cc1d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:27.713690 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f8a8dd2a-fd71-4ba6-b4fe-c5fec988cc1d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:27.714127 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f8a8dd2a-fd71-4ba6-b4fe-c5fec988cc1d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:30.680453 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f8a8dd2a-fd71-4ba6-b4fe-c5fec988cc1d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "POST /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.983452 May 18 17:17:30.681176 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 479/943] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:17:27 2022] POST /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-volume_attachments => generated 194 bytes in 2985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:17:41.593404 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-063f2fb8-5eef-4f74-85ac-d6593bd4d902 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:41.593896 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-063f2fb8-5eef-4f74-85ac-d6593bd4d902 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:41.597617 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:41.598368 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:41.604633 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-063f2fb8-5eef-4f74-85ac-d6593bd4d902 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:41.605096 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-063f2fb8-5eef-4f74-85ac-d6593bd4d902 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:41.605962 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-063f2fb8-5eef-4f74-85ac-d6593bd4d902 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:41.606407 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-063f2fb8-5eef-4f74-85ac-d6593bd4d902 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:41.701699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-063f2fb8-5eef-4f74-85ac-d6593bd4d902 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lazy-loading 'services' on Instance uuid 96f69790-703a-4113-8e50-78596b799cf8 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:17:41.778685 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-063f2fb8-5eef-4f74-85ac-d6593bd4d902 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-volume_attachments/db008606-913c-4310-bd66-a92a788334d4" status: 202 len: 0 microversion: 2.1 time: 0.189376 May 18 17:17:41.779323 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 465/944] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:17:41 2022] DELETE /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-volume_attachments/db008606-913c-4310-bd66-a92a788334d4 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:17:41.786098 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:41.787311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:17:41.791595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d69f3a81-72f6-4ac9-b07c-92afd0323282 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:41.792687 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d69f3a81-72f6-4ac9-b07c-92afd0323282 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:41.800477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d69f3a81-72f6-4ac9-b07c-92afd0323282 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:41.800923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d69f3a81-72f6-4ac9-b07c-92afd0323282 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:41.801725 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d69f3a81-72f6-4ac9-b07c-92afd0323282 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:41.802161 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d69f3a81-72f6-4ac9-b07c-92afd0323282 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:41.834776 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d69f3a81-72f6-4ac9-b07c-92afd0323282 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050055 May 18 17:17:41.835333 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 480/945] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:17:41 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:17:42.849237 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0a140a69-3c78-46d9-9b0c-36528016daf1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:42.850300 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0a140a69-3c78-46d9-9b0c-36528016daf1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:42.860798 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a140a69-3c78-46d9-9b0c-36528016daf1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:42.861181 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a140a69-3c78-46d9-9b0c-36528016daf1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:42.862900 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a140a69-3c78-46d9-9b0c-36528016daf1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:42.863369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0a140a69-3c78-46d9-9b0c-36528016daf1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:42.895853 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0a140a69-3c78-46d9-9b0c-36528016daf1 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052785 May 18 17:17:42.896417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 466/946] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:17:42 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 17:17:42.961998 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-64748748-3c4f-443f-8d73-1d41e2a870a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:42.962518 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-64748748-3c4f-443f-8d73-1d41e2a870a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:42.968763 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64748748-3c4f-443f-8d73-1d41e2a870a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:42.969218 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64748748-3c4f-443f-8d73-1d41e2a870a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:42.970014 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64748748-3c4f-443f-8d73-1d41e2a870a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:42.970456 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64748748-3c4f-443f-8d73-1d41e2a870a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:42.997593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-64748748-3c4f-443f-8d73-1d41e2a870a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:17:43.074905 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-64748748-3c4f-443f-8d73-1d41e2a870a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 204 len: 0 microversion: 2.1 time: 0.116947 May 18 17:17:43.075471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 481/947] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:17:42 2022] DELETE /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:17:43.085413 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f804b85a-aa66-4b96-90f2-467d5d0ab008 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:43.086100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f804b85a-aa66-4b96-90f2-467d5d0ab008 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:43.092243 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f804b85a-aa66-4b96-90f2-467d5d0ab008 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:43.092957 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f804b85a-aa66-4b96-90f2-467d5d0ab008 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:43.093758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f804b85a-aa66-4b96-90f2-467d5d0ab008 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:43.094369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f804b85a-aa66-4b96-90f2-467d5d0ab008 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:43.232145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f804b85a-aa66-4b96-90f2-467d5d0ab008 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:43.240169 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f804b85a-aa66-4b96-90f2-467d5d0ab008 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1678 microversion: 2.1 time: 0.160469 May 18 17:17:43.240735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 467/948] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:43 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:17:44.258282 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-0c5f8072-8a4c-48c8-85de-4a3ca2ab8558 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:44.259304 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-0c5f8072-8a4c-48c8-85de-4a3ca2ab8558 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:44.275457 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c5f8072-8a4c-48c8-85de-4a3ca2ab8558 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:44.276068 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c5f8072-8a4c-48c8-85de-4a3ca2ab8558 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:44.276895 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c5f8072-8a4c-48c8-85de-4a3ca2ab8558 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:44.277335 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-0c5f8072-8a4c-48c8-85de-4a3ca2ab8558 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:44.433311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-0c5f8072-8a4c-48c8-85de-4a3ca2ab8558 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:44.441599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-0c5f8072-8a4c-48c8-85de-4a3ca2ab8558 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1678 microversion: 2.1 time: 0.188259 May 18 17:17:44.442226 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 482/949] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:44 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:17:45.459601 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d9dc8722-7ed4-4fc8-8231-fba4fa8f7287 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:45.460620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d9dc8722-7ed4-4fc8-8231-fba4fa8f7287 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:45.467835 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d9dc8722-7ed4-4fc8-8231-fba4fa8f7287 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:45.468635 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d9dc8722-7ed4-4fc8-8231-fba4fa8f7287 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:45.469626 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d9dc8722-7ed4-4fc8-8231-fba4fa8f7287 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:45.470478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d9dc8722-7ed4-4fc8-8231-fba4fa8f7287 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:45.747382 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d9dc8722-7ed4-4fc8-8231-fba4fa8f7287 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:45.757884 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d9dc8722-7ed4-4fc8-8231-fba4fa8f7287 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1678 microversion: 2.1 time: 0.302501 May 18 17:17:45.759206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 468/950] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:45 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1678 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:17:46.418759 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-2386a85d-c2d0-455a-a138-f7454a462a72 req-77713778-d674-4109-916c-128629ccbca1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96f69790-703a-4113-8e50-78596b799cf8", "name": "network-vif-deleted", "tag": "de7989e0-a808-420c-bd56-6a7ded825afb"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:17:46.430096 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-2386a85d-c2d0-455a-a138-f7454a462a72 req-77713778-d674-4109-916c-128629ccbca1 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:46.430551 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-2386a85d-c2d0-455a-a138-f7454a462a72 req-77713778-d674-4109-916c-128629ccbca1 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:46.443448 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-2386a85d-c2d0-455a-a138-f7454a462a72 req-77713778-d674-4109-916c-128629ccbca1 service nova] Creating event network-vif-deleted:de7989e0-a808-420c-bd56-6a7ded825afb for instance 96f69790-703a-4113-8e50-78596b799cf8 on hv-cinder-79578 May 18 17:17:46.449043 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-2386a85d-c2d0-455a-a138-f7454a462a72 req-77713778-d674-4109-916c-128629ccbca1 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213996 May 18 17:17:46.450126 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 483/951] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:17:46.781608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:46.783590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:46.790416 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:46.790880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:46.791673 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:46.792134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:46.831580 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:46.832287 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:46.832976 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lazy-loading 'fault' on Instance uuid 96f69790-703a-4113-8e50-78596b799cf8 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:17:46.878401 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01881ccdf756480b8fcc1ac599fdf905', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f5daaa505d4985a76f95f1cf7b2da6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:17:46.885251 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bcbe9517-502e-45b1-8923-3b96c5cd36a7 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 200 len: 1330 microversion: 2.1 time: 0.107476 May 18 17:17:46.885888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 469/952] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:46 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:17:47.903361 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:47.903962 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:47.911685 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:47.912170 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:47.912943 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:47.913384 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:47.928140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 HTTP/1.1 May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:17:47.929820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:47.931447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '96f69790-703a-4113-8e50-78596b799cf8'} May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:47.932555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:47.934259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:47.935724 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:47.935724 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-96e97f21-40e6-4a4c-ab85-3f17ecd4f05d tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 404 len: 111 microversion: 2.1 time: 0.032601 May 18 17:17:47.935724 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 484/953] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:47 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:17:47.940443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a96886dc-3a8a-461a-814a-a096e65d3a9c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '.version_select at 0x7fef00210b80>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:47.958342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a96886dc-3a8a-461a-814a-a096e65d3a9c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583919513" status: 202 len: 0 microversion: 2.1 time: 0.021791 May 18 17:17:47.959016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 470/954] 10.222.0.49 () {58 vars in 1220 bytes} [Wed May 18 17:17:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583919513 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:17:49.712063 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:49.712645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:49.719564 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:49.720011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:49.721425 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:49.721890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:49.735344 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 HTTP/1.1 May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:17:49.736949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.738579 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '96f69790-703a-4113-8e50-78596b799cf8'} May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:49.739567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.741247 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:49.743132 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:49.743132 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-750bcf42-ad9d-4b33-95a6-c7f42ca1d163 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 404 len: 111 microversion: 2.1 time: 0.030496 May 18 17:17:49.743132 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 485/955] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:17:49 2022] DELETE /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:17:49.748559 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:49.749212 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 96f69790-703a-4113-8e50-78596b799cf8] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:49.756389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:49.756844 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:49.757975 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:49.758418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:49.772600 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 HTTP/1.1 May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:17:49.774284 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.775649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '96f69790-703a-4113-8e50-78596b799cf8'} May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:49.776590 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. May 18 17:17:49.778140 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:49.779463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 96f69790-703a-4113-8e50-78596b799cf8 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:49.779463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f839ffca-9874-40e6-8777-fa7cedae225c tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8" status: 404 len: 111 microversion: 2.1 time: 0.031775 May 18 17:17:49.779463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 471/956] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:49 2022] GET /compute/v2.1/servers/96f69790-703a-4113-8e50-78596b799cf8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:17:50.927321 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:50.927869 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:50.934234 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:50.934694 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:50.935475 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:50.935922 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:50.950709 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc HTTP/1.1 May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:17:50.952386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.953986 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '8dc5c540-cca9-45b1-8f26-a3a7e20726fc'} May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:50.955199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.956599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:50.958609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:50.958609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6ae0942f-3145-4567-8c01-2d662b8c4d74 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 404 len: 111 microversion: 2.1 time: 0.032872 May 18 17:17:50.958609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 486/957] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:17:50 2022] DELETE /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:17:50.963561 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:50.964181 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 8dc5c540-cca9-45b1-8f26-a3a7e20726fc] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:50.971933 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:50.972401 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:50.973164 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:50.973599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:50.988186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc HTTP/1.1 May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:17:50.989735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.991074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '8dc5c540-cca9-45b1-8f26-a3a7e20726fc'} May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:50.992262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. May 18 17:17:50.994077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:50.995906 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 8dc5c540-cca9-45b1-8f26-a3a7e20726fc could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:50.995906 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-805f5bc2-b175-47bb-b688-410de710d80b tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc" status: 404 len: 111 microversion: 2.1 time: 0.031576 May 18 17:17:50.995906 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 472/958] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:50 2022] GET /compute/v2.1/servers/8dc5c540-cca9-45b1-8f26-a3a7e20726fc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:17:50.999617 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:51.000122 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:51.007523 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:51.007979 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:51.008859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:51.009301 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:51.024963 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a HTTP/1.1 May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:17:51.026569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.027947 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': 'fe8e9b40-b673-4589-8cc1-578d155c9f9a'} May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:51.028696 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.029930 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:51.031169 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:51.031169 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-523b2cfd-78a9-46a8-921d-e0964c9bb2ce tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 404 len: 111 microversion: 2.1 time: 0.032151 May 18 17:17:51.031169 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 487/959] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:17:50 2022] DELETE /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:17:51.037456 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:51.038119 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: fe8e9b40-b673-4589-8cc1-578d155c9f9a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:51.044165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:51.044624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:51.045430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:51.046085 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:51.061898 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a HTTP/1.1 May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:17:51.063501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.064836 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'fe8e9b40-b673-4589-8cc1-578d155c9f9a'} May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:51.065735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. May 18 17:17:51.067762 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:51.070806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance fe8e9b40-b673-4589-8cc1-578d155c9f9a could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:51.070806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-db314098-3bac-498f-951f-a1c8b9572d53 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a" status: 404 len: 111 microversion: 2.1 time: 0.032082 May 18 17:17:51.070806 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 473/960] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:51 2022] GET /compute/v2.1/servers/fe8e9b40-b673-4589-8cc1-578d155c9f9a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:17:52.236858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:52.238088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:52.245475 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:52.245957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:52.247034 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:52.247719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:52.263370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e HTTP/1.1 May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:17:52.264935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.266488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '76ee8046-a947-4f1c-badc-cdf4a50fcd6e'} May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:52.267989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.269179 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:17:52.270641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:52.270641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fb51947d-7302-4fd3-985b-f24471a38149 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "DELETE /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 404 len: 111 microversion: 2.1 time: 0.033404 May 18 17:17:52.270641 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 488/961] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:17:52 2022] DELETE /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:17:52.275657 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:17:52.276270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] [instance: 76ee8046-a947-4f1c-badc-cdf4a50fcd6e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:17:52.283114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:52.283555 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:52.284807 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:17:52.285235 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:17:52.299076 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] HTTP exception thrown: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Request method failure captured: May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e HTTP/1.1 May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSd5w113wqQ_QokOl-0SHcoJ7XrDKdNeolV4daKeAKLT5Sc-BvukMf7U5QI9O1O60-JFoZNvqcHaWUMDAavr72wILjNpOLHbEid_y5din3LCQJLQz42zngqcTw65a2E2AtsuPVvnwc-Aph1hCK7SjZNID9QheeO0ylepWhR-TTxqkvQ May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:17:52.301409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/b0f5daaa505d4985a76f95f1cf7b2da6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: b0f5daaa505d4985a76f95f1cf7b2da6 May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-340394553 May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 01881ccdf756480b8fcc1ac599fdf905 May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeNegativeTest-340394553-project May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.302880 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '76ee8046-a947-4f1c-badc-cdf4a50fcd6e'} May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:17:52.303729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. May 18 17:17:52.305254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:17:52.306563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] Returning 404 to user: Instance 76ee8046-a947-4f1c-badc-cdf4a50fcd6e could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:17:52.306563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-be3c5119-1c1f-4638-99a2-fcf0d05df829 tempest-AttachVolumeNegativeTest-340394553 tempest-AttachVolumeNegativeTest-340394553-project] 10.222.0.49 "GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e" status: 404 len: 111 microversion: 2.1 time: 0.031321 May 18 17:17:52.306563 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 474/962] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:17:52 2022] GET /compute/v2.1/servers/76ee8046-a947-4f1c-badc-cdf4a50fcd6e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:18:16.239615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7394209f-c7e0-4d70-bdd2-7e3442732293 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:18:16.240571 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7394209f-c7e0-4d70-bdd2-7e3442732293 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:16.243328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:16.243996 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:16.250183 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7394209f-c7e0-4d70-bdd2-7e3442732293 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:16.250626 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7394209f-c7e0-4d70-bdd2-7e3442732293 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:16.251403 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7394209f-c7e0-4d70-bdd2-7e3442732293 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:16.251843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7394209f-c7e0-4d70-bdd2-7e3442732293 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:16.336291 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7394209f-c7e0-4d70-bdd2-7e3442732293 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "POST /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/action" status: 202 len: 0 microversion: 2.1 time: 0.100410 May 18 17:18:16.338811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 489/963] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:18:16 2022] POST /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:18:16.346750 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d7ac4b12-cdd1-4824-aa70-17e6e1c78fec tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:16.347548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d7ac4b12-cdd1-4824-aa70-17e6e1c78fec tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:16.349596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:16.350688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:16.356881 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7ac4b12-cdd1-4824-aa70-17e6e1c78fec tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:16.357288 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7ac4b12-cdd1-4824-aa70-17e6e1c78fec tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:16.358503 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7ac4b12-cdd1-4824-aa70-17e6e1c78fec tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:16.358696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d7ac4b12-cdd1-4824-aa70-17e6e1c78fec tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:16.513645 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d7ac4b12-cdd1-4824-aa70-17e6e1c78fec tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:16.523545 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d7ac4b12-cdd1-4824-aa70-17e6e1c78fec tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1749 microversion: 2.1 time: 0.181750 May 18 17:18:16.524126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 475/964] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:16 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1749 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:17.543528 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5cabbba1-4181-4cc4-9110-e331dd261007 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:17.544281 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5cabbba1-4181-4cc4-9110-e331dd261007 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:17.554047 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5cabbba1-4181-4cc4-9110-e331dd261007 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:17.554505 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5cabbba1-4181-4cc4-9110-e331dd261007 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:17.555471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5cabbba1-4181-4cc4-9110-e331dd261007 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:17.555906 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5cabbba1-4181-4cc4-9110-e331dd261007 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:17.751495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5cabbba1-4181-4cc4-9110-e331dd261007 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:17.761062 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5cabbba1-4181-4cc4-9110-e331dd261007 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1749 microversion: 2.1 time: 0.222929 May 18 17:18:17.761645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 490/965] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:17 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1749 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:18.778852 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b4622028-9dce-4547-a640-e898c5d0f175 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:18.779655 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b4622028-9dce-4547-a640-e898c5d0f175 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:18.786965 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4622028-9dce-4547-a640-e898c5d0f175 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:18.787416 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4622028-9dce-4547-a640-e898c5d0f175 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:18.788202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4622028-9dce-4547-a640-e898c5d0f175 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:18.788639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4622028-9dce-4547-a640-e898c5d0f175 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:18.960867 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4622028-9dce-4547-a640-e898c5d0f175 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:18.970593 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b4622028-9dce-4547-a640-e898c5d0f175 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1749 microversion: 2.1 time: 0.195611 May 18 17:18:18.971225 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 476/966] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:18 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1749 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:19.989027 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1d65aa82-f983-405f-8689-80d4fd065d13 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:19.989783 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1d65aa82-f983-405f-8689-80d4fd065d13 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:19.996679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1d65aa82-f983-405f-8689-80d4fd065d13 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:19.997127 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1d65aa82-f983-405f-8689-80d4fd065d13 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:19.997951 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1d65aa82-f983-405f-8689-80d4fd065d13 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:19.998503 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1d65aa82-f983-405f-8689-80d4fd065d13 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:20.153382 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1d65aa82-f983-405f-8689-80d4fd065d13 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:20.161811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1d65aa82-f983-405f-8689-80d4fd065d13 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.177092 May 18 17:18:20.162401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 491/967] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:19 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:21.180082 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7b596a08-96e0-460e-b572-92ea51516a6c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:21.180695 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7b596a08-96e0-460e-b572-92ea51516a6c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:21.187214 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b596a08-96e0-460e-b572-92ea51516a6c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:21.187666 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b596a08-96e0-460e-b572-92ea51516a6c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:21.188433 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b596a08-96e0-460e-b572-92ea51516a6c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:21.188871 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b596a08-96e0-460e-b572-92ea51516a6c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:21.357940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7b596a08-96e0-460e-b572-92ea51516a6c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:21.367747 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7b596a08-96e0-460e-b572-92ea51516a6c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.191426 May 18 17:18:21.368341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 477/968] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:21 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:22.387437 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7d498b9f-c51b-4b87-bdca-67ec8116bacc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:22.388079 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7d498b9f-c51b-4b87-bdca-67ec8116bacc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:22.395476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d498b9f-c51b-4b87-bdca-67ec8116bacc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:22.395921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d498b9f-c51b-4b87-bdca-67ec8116bacc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:22.396691 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d498b9f-c51b-4b87-bdca-67ec8116bacc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:22.397120 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d498b9f-c51b-4b87-bdca-67ec8116bacc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:22.551235 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7d498b9f-c51b-4b87-bdca-67ec8116bacc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:22.559707 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7d498b9f-c51b-4b87-bdca-67ec8116bacc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.176115 May 18 17:18:22.560289 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 492/969] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:22 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:18:23.577971 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2dc0ff60-1542-457d-919d-0f0dc489b792 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:23.578619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2dc0ff60-1542-457d-919d-0f0dc489b792 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:23.586715 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2dc0ff60-1542-457d-919d-0f0dc489b792 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:23.587173 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2dc0ff60-1542-457d-919d-0f0dc489b792 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:23.587949 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2dc0ff60-1542-457d-919d-0f0dc489b792 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:23.588386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2dc0ff60-1542-457d-919d-0f0dc489b792 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:23.743145 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2dc0ff60-1542-457d-919d-0f0dc489b792 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:23.751823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2dc0ff60-1542-457d-919d-0f0dc489b792 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.177690 May 18 17:18:23.752544 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 478/970] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:23 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:24.770592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-727bec67-4918-4cac-b4ad-215c3bbfa4b8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:24.771210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-727bec67-4918-4cac-b4ad-215c3bbfa4b8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:24.777697 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-727bec67-4918-4cac-b4ad-215c3bbfa4b8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:24.778149 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-727bec67-4918-4cac-b4ad-215c3bbfa4b8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:24.778915 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-727bec67-4918-4cac-b4ad-215c3bbfa4b8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:24.779343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-727bec67-4918-4cac-b4ad-215c3bbfa4b8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:24.926645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-727bec67-4918-4cac-b4ad-215c3bbfa4b8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:24.935769 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-727bec67-4918-4cac-b4ad-215c3bbfa4b8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.169066 May 18 17:18:24.936429 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 493/971] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:24 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:25.953952 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-45b14e24-d50f-4fe2-b0c0-69984244c935 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:25.954572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-45b14e24-d50f-4fe2-b0c0-69984244c935 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:25.961972 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-45b14e24-d50f-4fe2-b0c0-69984244c935 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:25.962427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-45b14e24-d50f-4fe2-b0c0-69984244c935 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:25.963223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-45b14e24-d50f-4fe2-b0c0-69984244c935 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:25.963665 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-45b14e24-d50f-4fe2-b0c0-69984244c935 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:26.123730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-45b14e24-d50f-4fe2-b0c0-69984244c935 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:26.133221 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-45b14e24-d50f-4fe2-b0c0-69984244c935 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.183172 May 18 17:18:26.133828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 479/972] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:25 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:27.150447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c94ea7d5-e80e-40e7-b4ca-6e85213ea93a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:27.151060 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c94ea7d5-e80e-40e7-b4ca-6e85213ea93a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:27.157530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c94ea7d5-e80e-40e7-b4ca-6e85213ea93a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:27.158004 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c94ea7d5-e80e-40e7-b4ca-6e85213ea93a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:27.159319 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c94ea7d5-e80e-40e7-b4ca-6e85213ea93a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:27.159795 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c94ea7d5-e80e-40e7-b4ca-6e85213ea93a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:27.303587 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c94ea7d5-e80e-40e7-b4ca-6e85213ea93a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:27.311677 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c94ea7d5-e80e-40e7-b4ca-6e85213ea93a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.165106 May 18 17:18:27.312240 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 494/973] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:27 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:28.328945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bedd2eb8-a613-4de3-8885-efe4ee3b98bb tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:28.329546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bedd2eb8-a613-4de3-8885-efe4ee3b98bb tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:28.336577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bedd2eb8-a613-4de3-8885-efe4ee3b98bb tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:28.337028 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bedd2eb8-a613-4de3-8885-efe4ee3b98bb tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:28.337825 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bedd2eb8-a613-4de3-8885-efe4ee3b98bb tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:28.338260 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bedd2eb8-a613-4de3-8885-efe4ee3b98bb tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:28.483424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bedd2eb8-a613-4de3-8885-efe4ee3b98bb tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:28.492390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bedd2eb8-a613-4de3-8885-efe4ee3b98bb tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.167507 May 18 17:18:28.492965 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 480/974] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:28 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:29.509812 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1b38bdb1-95f9-40d0-9384-3363e6f53088 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:29.510451 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1b38bdb1-95f9-40d0-9384-3363e6f53088 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:29.516569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1b38bdb1-95f9-40d0-9384-3363e6f53088 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:29.517012 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1b38bdb1-95f9-40d0-9384-3363e6f53088 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:29.518313 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1b38bdb1-95f9-40d0-9384-3363e6f53088 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:29.518745 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1b38bdb1-95f9-40d0-9384-3363e6f53088 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:29.668332 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1b38bdb1-95f9-40d0-9384-3363e6f53088 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:29.676879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1b38bdb1-95f9-40d0-9384-3363e6f53088 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.171057 May 18 17:18:29.677581 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 495/975] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:29 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:30.694184 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e296c745-2df5-483f-92be-4db91a863ee6 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:30.694791 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e296c745-2df5-483f-92be-4db91a863ee6 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:30.702062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e296c745-2df5-483f-92be-4db91a863ee6 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:30.702507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e296c745-2df5-483f-92be-4db91a863ee6 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:30.703574 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e296c745-2df5-483f-92be-4db91a863ee6 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:30.704006 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e296c745-2df5-483f-92be-4db91a863ee6 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:30.850155 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e296c745-2df5-483f-92be-4db91a863ee6 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:30.858097 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e296c745-2df5-483f-92be-4db91a863ee6 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.167708 May 18 17:18:30.858662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 481/976] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:30 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:31.877928 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bfe4a7db-6a46-4eda-bd13-3619a73bfda8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:31.878546 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bfe4a7db-6a46-4eda-bd13-3619a73bfda8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:31.885173 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bfe4a7db-6a46-4eda-bd13-3619a73bfda8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:31.885626 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bfe4a7db-6a46-4eda-bd13-3619a73bfda8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:31.886420 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bfe4a7db-6a46-4eda-bd13-3619a73bfda8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:31.886867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bfe4a7db-6a46-4eda-bd13-3619a73bfda8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:32.032970 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bfe4a7db-6a46-4eda-bd13-3619a73bfda8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:32.041592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bfe4a7db-6a46-4eda-bd13-3619a73bfda8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.168365 May 18 17:18:32.042125 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 496/977] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:31 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:18:33.061537 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-093e280f-28d2-4cc5-8631-a05e574b575f tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:33.062522 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-093e280f-28d2-4cc5-8631-a05e574b575f tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:33.073760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-093e280f-28d2-4cc5-8631-a05e574b575f tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:33.074925 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-093e280f-28d2-4cc5-8631-a05e574b575f tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:33.075404 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-093e280f-28d2-4cc5-8631-a05e574b575f tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:33.075887 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-093e280f-28d2-4cc5-8631-a05e574b575f tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:33.224400 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-093e280f-28d2-4cc5-8631-a05e574b575f tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:33.232479 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-093e280f-28d2-4cc5-8631-a05e574b575f tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.176890 May 18 17:18:33.233054 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 482/978] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:33 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:34.250227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d01ca780-d77b-47c5-b89e-c3b02e4ff07d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:34.250836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d01ca780-d77b-47c5-b89e-c3b02e4ff07d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:34.258343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d01ca780-d77b-47c5-b89e-c3b02e4ff07d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:34.259103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d01ca780-d77b-47c5-b89e-c3b02e4ff07d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:34.260447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d01ca780-d77b-47c5-b89e-c3b02e4ff07d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:34.261229 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d01ca780-d77b-47c5-b89e-c3b02e4ff07d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:34.412934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-d01ca780-d77b-47c5-b89e-c3b02e4ff07d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:34.420879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d01ca780-d77b-47c5-b89e-c3b02e4ff07d tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.174533 May 18 17:18:34.421436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 497/979] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:34 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:35.438029 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-315b4503-063b-451c-b7d0-8062ea5d2e3e tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:35.438671 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-315b4503-063b-451c-b7d0-8062ea5d2e3e tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:35.445173 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-315b4503-063b-451c-b7d0-8062ea5d2e3e tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:35.445621 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-315b4503-063b-451c-b7d0-8062ea5d2e3e tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:35.446412 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-315b4503-063b-451c-b7d0-8062ea5d2e3e tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:35.446850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-315b4503-063b-451c-b7d0-8062ea5d2e3e tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:35.594584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-315b4503-063b-451c-b7d0-8062ea5d2e3e tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:35.605146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-315b4503-063b-451c-b7d0-8062ea5d2e3e tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.170941 May 18 17:18:35.605936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 483/980] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:35 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:36.622774 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-012b50ca-e3f1-4648-8eb1-e66d1d8a4e17 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:36.623391 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-012b50ca-e3f1-4648-8eb1-e66d1d8a4e17 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:36.630530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-012b50ca-e3f1-4648-8eb1-e66d1d8a4e17 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:36.630985 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-012b50ca-e3f1-4648-8eb1-e66d1d8a4e17 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:36.631760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-012b50ca-e3f1-4648-8eb1-e66d1d8a4e17 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:36.632204 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-012b50ca-e3f1-4648-8eb1-e66d1d8a4e17 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:36.780402 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-012b50ca-e3f1-4648-8eb1-e66d1d8a4e17 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:36.789403 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-012b50ca-e3f1-4648-8eb1-e66d1d8a4e17 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.170473 May 18 17:18:36.790071 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 498/981] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:36 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:37.808244 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c382a8d0-8abb-4c31-9d69-07a0d1f4573b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:37.808875 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c382a8d0-8abb-4c31-9d69-07a0d1f4573b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:37.815689 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c382a8d0-8abb-4c31-9d69-07a0d1f4573b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:37.816131 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c382a8d0-8abb-4c31-9d69-07a0d1f4573b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:37.816917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c382a8d0-8abb-4c31-9d69-07a0d1f4573b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:37.817353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c382a8d0-8abb-4c31-9d69-07a0d1f4573b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:37.969565 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c382a8d0-8abb-4c31-9d69-07a0d1f4573b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:37.978902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c382a8d0-8abb-4c31-9d69-07a0d1f4573b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.174509 May 18 17:18:37.979465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 484/982] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:37 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:38.996266 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-55f0df51-ee0e-4e65-9475-2df27bdaa059 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:38.996890 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-55f0df51-ee0e-4e65-9475-2df27bdaa059 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:39.003596 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55f0df51-ee0e-4e65-9475-2df27bdaa059 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:39.004054 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55f0df51-ee0e-4e65-9475-2df27bdaa059 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:39.004854 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55f0df51-ee0e-4e65-9475-2df27bdaa059 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:39.005300 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-55f0df51-ee0e-4e65-9475-2df27bdaa059 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:39.153917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-55f0df51-ee0e-4e65-9475-2df27bdaa059 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:39.163271 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-55f0df51-ee0e-4e65-9475-2df27bdaa059 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.170784 May 18 17:18:39.163966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 499/983] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:38 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:40.180547 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c76cfc7d-baa7-4493-8cf6-60c49c4126c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:40.181161 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c76cfc7d-baa7-4493-8cf6-60c49c4126c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:40.187955 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c76cfc7d-baa7-4493-8cf6-60c49c4126c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:40.188408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c76cfc7d-baa7-4493-8cf6-60c49c4126c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:40.189189 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c76cfc7d-baa7-4493-8cf6-60c49c4126c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:40.189694 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c76cfc7d-baa7-4493-8cf6-60c49c4126c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:40.341623 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c76cfc7d-baa7-4493-8cf6-60c49c4126c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:40.350036 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c76cfc7d-baa7-4493-8cf6-60c49c4126c2 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.173245 May 18 17:18:40.350605 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 485/984] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:40 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:41.368366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ff7d6f5e-2f24-4951-9855-5efcb835a028 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:41.368981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ff7d6f5e-2f24-4951-9855-5efcb835a028 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:41.375559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ff7d6f5e-2f24-4951-9855-5efcb835a028 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:41.376011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ff7d6f5e-2f24-4951-9855-5efcb835a028 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:41.376803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ff7d6f5e-2f24-4951-9855-5efcb835a028 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:41.377366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ff7d6f5e-2f24-4951-9855-5efcb835a028 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:41.522341 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ff7d6f5e-2f24-4951-9855-5efcb835a028 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:41.530363 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ff7d6f5e-2f24-4951-9855-5efcb835a028 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.165773 May 18 17:18:41.530929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 500/985] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:41 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:42.547574 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c30a68f8-fe7c-4039-92b4-2162bc534104 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:42.548115 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c30a68f8-fe7c-4039-92b4-2162bc534104 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:42.555178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c30a68f8-fe7c-4039-92b4-2162bc534104 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:42.555622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c30a68f8-fe7c-4039-92b4-2162bc534104 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:42.556389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c30a68f8-fe7c-4039-92b4-2162bc534104 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:42.556818 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c30a68f8-fe7c-4039-92b4-2162bc534104 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:42.697099 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c30a68f8-fe7c-4039-92b4-2162bc534104 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:42.705112 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c30a68f8-fe7c-4039-92b4-2162bc534104 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.161409 May 18 17:18:42.705703 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 486/986] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:42 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:43.724085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a56ca891-268d-4ca9-9588-a2b561215ffc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:43.724700 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a56ca891-268d-4ca9-9588-a2b561215ffc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:43.731282 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a56ca891-268d-4ca9-9588-a2b561215ffc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:43.731732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a56ca891-268d-4ca9-9588-a2b561215ffc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:43.732493 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a56ca891-268d-4ca9-9588-a2b561215ffc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:43.732928 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a56ca891-268d-4ca9-9588-a2b561215ffc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:43.874892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a56ca891-268d-4ca9-9588-a2b561215ffc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:43.883549 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a56ca891-268d-4ca9-9588-a2b561215ffc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.164011 May 18 17:18:43.884120 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 501/987] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:43 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:44.908379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8e4ad27c-ac49-4cbc-90de-c4b1e05b893a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:44.909252 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8e4ad27c-ac49-4cbc-90de-c4b1e05b893a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:44.917317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e4ad27c-ac49-4cbc-90de-c4b1e05b893a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:44.918074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e4ad27c-ac49-4cbc-90de-c4b1e05b893a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:44.919043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e4ad27c-ac49-4cbc-90de-c4b1e05b893a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:44.919486 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8e4ad27c-ac49-4cbc-90de-c4b1e05b893a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:45.064697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8e4ad27c-ac49-4cbc-90de-c4b1e05b893a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:45.073865 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8e4ad27c-ac49-4cbc-90de-c4b1e05b893a tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.170357 May 18 17:18:45.074500 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 487/988] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:44 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:46.091526 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-294e578b-fbf2-4094-bb75-179d3dbc163c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:46.092177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-294e578b-fbf2-4094-bb75-179d3dbc163c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:46.100245 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294e578b-fbf2-4094-bb75-179d3dbc163c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:46.100701 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294e578b-fbf2-4094-bb75-179d3dbc163c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:46.101476 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294e578b-fbf2-4094-bb75-179d3dbc163c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:46.101941 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-294e578b-fbf2-4094-bb75-179d3dbc163c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:46.256582 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-294e578b-fbf2-4094-bb75-179d3dbc163c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:46.264538 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-294e578b-fbf2-4094-bb75-179d3dbc163c tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.176868 May 18 17:18:46.265097 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 502/989] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:46 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:47.283202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f46850e0-bb88-4f39-89ef-85bfdc1c6ba0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:47.283997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f46850e0-bb88-4f39-89ef-85bfdc1c6ba0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:47.286082 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=27 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:47.291447 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f46850e0-bb88-4f39-89ef-85bfdc1c6ba0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:47.291897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f46850e0-bb88-4f39-89ef-85bfdc1c6ba0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:47.292673 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f46850e0-bb88-4f39-89ef-85bfdc1c6ba0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:47.293109 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f46850e0-bb88-4f39-89ef-85bfdc1c6ba0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:47.295862 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=79 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:47.438800 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f46850e0-bb88-4f39-89ef-85bfdc1c6ba0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:47.448279 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f46850e0-bb88-4f39-89ef-85bfdc1c6ba0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.169121 May 18 17:18:47.448846 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 488/990] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:47 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:48.465937 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c41f5b41-5e5c-4247-961a-7d5206b36533 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:48.466577 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c41f5b41-5e5c-4247-961a-7d5206b36533 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:48.469219 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=29 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:48.475691 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c41f5b41-5e5c-4247-961a-7d5206b36533 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:48.476143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c41f5b41-5e5c-4247-961a-7d5206b36533 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:48.476903 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c41f5b41-5e5c-4247-961a-7d5206b36533 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:48.477334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c41f5b41-5e5c-4247-961a-7d5206b36533 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:48.481275 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:18:48.626376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c41f5b41-5e5c-4247-961a-7d5206b36533 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:48.634967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c41f5b41-5e5c-4247-961a-7d5206b36533 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.173151 May 18 17:18:48.635529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 503/991] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:48 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:49.652808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-da1ecd89-c328-4736-9ea2-b5af1a8336d8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:49.653428 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-da1ecd89-c328-4736-9ea2-b5af1a8336d8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:49.660868 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da1ecd89-c328-4736-9ea2-b5af1a8336d8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:49.661328 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da1ecd89-c328-4736-9ea2-b5af1a8336d8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:49.662134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da1ecd89-c328-4736-9ea2-b5af1a8336d8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:49.662575 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-da1ecd89-c328-4736-9ea2-b5af1a8336d8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:49.815225 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-da1ecd89-c328-4736-9ea2-b5af1a8336d8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:49.823885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-da1ecd89-c328-4736-9ea2-b5af1a8336d8 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1754 microversion: 2.1 time: 0.175000 May 18 17:18:49.824453 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 489/992] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:49 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1754 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:18:50.840566 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-12002d66-ef55-48df-9d2b-c0df82acf0d3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:18:50.841190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-12002d66-ef55-48df-9d2b-c0df82acf0d3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:18:50.848884 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-12002d66-ef55-48df-9d2b-c0df82acf0d3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:50.849339 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-12002d66-ef55-48df-9d2b-c0df82acf0d3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:50.850136 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-12002d66-ef55-48df-9d2b-c0df82acf0d3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:18:50.850593 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-12002d66-ef55-48df-9d2b-c0df82acf0d3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:18:51.001964 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-12002d66-ef55-48df-9d2b-c0df82acf0d3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:18:51.014980 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-12002d66-ef55-48df-9d2b-c0df82acf0d3 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1757 microversion: 2.1 time: 0.178011 May 18 17:18:51.015881 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 504/993] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:18:50 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:02.028810 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-451285079", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "networks": [{"uuid": "3692996f-6f1c-4118-b653-236b372a2550"}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:02.038486 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:02.039496 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=11 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:02.094696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] validate_networks() for [('3692996f-6f1c-4118-b653-236b372a2550', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:19:02.555476 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:19:02.555971 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:19:02.556699 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:19:02.557114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:19:02.557529 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:19:02.568565 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:02.569020 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:02.569943 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:02.570421 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:02.592475 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Getting quotas for project 73a1d41bf5e24b54972ce29acb4b11a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:19:02.598257 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Getting quotas for user ae6e9f34c1e0408bac7c252f9ecdd7e7 and project 73a1d41bf5e24b54972ce29acb4b11a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:19:02.618067 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:19:02.621726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:19:02.672251 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c4756781-1c33-4494-b2a3-c5354fbe3334 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.647297 May 18 17:19:02.673096 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 490/994] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:19:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:19:02.683483 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bd8ef855-3f25-4077-9285-3eed5497cf4e tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:02.684101 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bd8ef855-3f25-4077-9285-3eed5497cf4e tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:02.686583 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:02.687961 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=11 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:02.763417 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bd8ef855-3f25-4077-9285-3eed5497cf4e tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:02.772059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bd8ef855-3f25-4077-9285-3eed5497cf4e tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1213 microversion: 2.1 time: 0.092633 May 18 17:19:02.772679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 505/995] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:02 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:03.789061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b178ecd5-72f0-4f0f-bcd8-ad3386b93c00 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:03.790508 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b178ecd5-72f0-4f0f-bcd8-ad3386b93c00 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:03.798153 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b178ecd5-72f0-4f0f-bcd8-ad3386b93c00 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:03.798735 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b178ecd5-72f0-4f0f-bcd8-ad3386b93c00 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:03.800591 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b178ecd5-72f0-4f0f-bcd8-ad3386b93c00 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:03.801187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b178ecd5-72f0-4f0f-bcd8-ad3386b93c00 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:03.894775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b178ecd5-72f0-4f0f-bcd8-ad3386b93c00 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:03.904510 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b178ecd5-72f0-4f0f-bcd8-ad3386b93c00 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1273 microversion: 2.1 time: 0.119341 May 18 17:19:03.915578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 491/996] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:03 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:04.928863 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-cf35f427-3559-4c3c-bdee-eae6d1773bcc tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:04.929455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-cf35f427-3559-4c3c-bdee-eae6d1773bcc tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:04.935899 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cf35f427-3559-4c3c-bdee-eae6d1773bcc tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:04.936513 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cf35f427-3559-4c3c-bdee-eae6d1773bcc tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:04.937303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cf35f427-3559-4c3c-bdee-eae6d1773bcc tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:04.937781 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-cf35f427-3559-4c3c-bdee-eae6d1773bcc tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:05.072000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-cf35f427-3559-4c3c-bdee-eae6d1773bcc tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:05.079692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-cf35f427-3559-4c3c-bdee-eae6d1773bcc tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1313 microversion: 2.1 time: 0.156034 May 18 17:19:05.080348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 506/997] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:04 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:05.405465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-be7c7340-226a-41a7-a585-566540faf7ea req-2ba454d9-df59-43bd-8511-1f82db5b0019 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "949ced75-d278-4a85-aea5-b14c6a8c672e", "tag": "607c5562-f08b-4306-b2bb-feb8a3b27cd2"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:05.417827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-be7c7340-226a-41a7-a585-566540faf7ea req-2ba454d9-df59-43bd-8511-1f82db5b0019 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:05.418641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-be7c7340-226a-41a7-a585-566540faf7ea req-2ba454d9-df59-43bd-8511-1f82db5b0019 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:05.432701 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-be7c7340-226a-41a7-a585-566540faf7ea req-2ba454d9-df59-43bd-8511-1f82db5b0019 service nova] Creating event network-changed:607c5562-f08b-4306-b2bb-feb8a3b27cd2 for instance 949ced75-d278-4a85-aea5-b14c6a8c672e on hv-cinder-79578 May 18 17:19:05.438830 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-be7c7340-226a-41a7-a585-566540faf7ea req-2ba454d9-df59-43bd-8511-1f82db5b0019 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037809 May 18 17:19:05.440513 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 492/998] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:06.097610 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7a564809-2643-41cd-afd2-13975ccffe59 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:06.098193 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7a564809-2643-41cd-afd2-13975ccffe59 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:06.104729 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a564809-2643-41cd-afd2-13975ccffe59 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:06.105182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a564809-2643-41cd-afd2-13975ccffe59 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:06.106006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a564809-2643-41cd-afd2-13975ccffe59 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:06.106442 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a564809-2643-41cd-afd2-13975ccffe59 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:06.240757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7a564809-2643-41cd-afd2-13975ccffe59 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:06.248206 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7a564809-2643-41cd-afd2-13975ccffe59 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1313 microversion: 2.1 time: 0.154912 May 18 17:19:06.248766 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 507/999] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:06 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:19:07.267022 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2e9843b9-b129-4ccd-9d86-3ee6039f02d9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:07.268006 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2e9843b9-b129-4ccd-9d86-3ee6039f02d9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:07.274909 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2e9843b9-b129-4ccd-9d86-3ee6039f02d9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:07.275446 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2e9843b9-b129-4ccd-9d86-3ee6039f02d9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:07.276296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2e9843b9-b129-4ccd-9d86-3ee6039f02d9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:07.276810 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2e9843b9-b129-4ccd-9d86-3ee6039f02d9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:07.415504 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2e9843b9-b129-4ccd-9d86-3ee6039f02d9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:07.422962 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2e9843b9-b129-4ccd-9d86-3ee6039f02d9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1313 microversion: 2.1 time: 0.160248 May 18 17:19:07.423537 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 493/1000] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:07 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:08.440053 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7d68d687-cea8-465e-b994-d6fdf6e873c3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:08.440800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7d68d687-cea8-465e-b994-d6fdf6e873c3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:08.448107 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d68d687-cea8-465e-b994-d6fdf6e873c3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:08.448789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d68d687-cea8-465e-b994-d6fdf6e873c3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:08.449679 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d68d687-cea8-465e-b994-d6fdf6e873c3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:08.450209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7d68d687-cea8-465e-b994-d6fdf6e873c3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:08.596624 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7d68d687-cea8-465e-b994-d6fdf6e873c3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:08.605736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7d68d687-cea8-465e-b994-d6fdf6e873c3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1313 microversion: 2.1 time: 0.170227 May 18 17:19:08.606650 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 508/1001] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:08 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:09.626668 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-026c4e5d-5bd4-4f25-b378-69fe5643f9e9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:09.628061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-026c4e5d-5bd4-4f25-b378-69fe5643f9e9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:09.637706 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-026c4e5d-5bd4-4f25-b378-69fe5643f9e9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:09.638190 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-026c4e5d-5bd4-4f25-b378-69fe5643f9e9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:09.638983 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-026c4e5d-5bd4-4f25-b378-69fe5643f9e9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:09.639425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-026c4e5d-5bd4-4f25-b378-69fe5643f9e9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:09.934704 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-026c4e5d-5bd4-4f25-b378-69fe5643f9e9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:09.943488 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-026c4e5d-5bd4-4f25-b378-69fe5643f9e9 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1313 microversion: 2.1 time: 0.322910 May 18 17:19:09.944075 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 494/1002] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:09 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:10.962835 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-033d14a9-13e6-44c1-8d5e-7b725909bd72 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:10.963600 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-033d14a9-13e6-44c1-8d5e-7b725909bd72 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:10.971073 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-033d14a9-13e6-44c1-8d5e-7b725909bd72 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:10.971555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-033d14a9-13e6-44c1-8d5e-7b725909bd72 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:10.972643 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-033d14a9-13e6-44c1-8d5e-7b725909bd72 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:10.973337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-033d14a9-13e6-44c1-8d5e-7b725909bd72 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:11.145448 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-033d14a9-13e6-44c1-8d5e-7b725909bd72 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:11.156720 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-033d14a9-13e6-44c1-8d5e-7b725909bd72 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1313 microversion: 2.1 time: 0.198040 May 18 17:19:11.158891 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 509/1003] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:10 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:12.175313 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1d816290-662a-48f4-a00e-b79355f55b03 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:12.175937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1d816290-662a-48f4-a00e-b79355f55b03 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:12.187421 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1d816290-662a-48f4-a00e-b79355f55b03 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:12.194639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1d816290-662a-48f4-a00e-b79355f55b03 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:12.196612 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1d816290-662a-48f4-a00e-b79355f55b03 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:12.198958 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1d816290-662a-48f4-a00e-b79355f55b03 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:12.199916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-b0082c5e-1385-4330-811f-86bf83e679db req-3de929da-ecc0-4f98-9ed4-a60783a69541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949ced75-d278-4a85-aea5-b14c6a8c672e", "name": "network-vif-plugged", "status": "completed", "tag": "607c5562-f08b-4306-b2bb-feb8a3b27cd2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:12.223424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b0082c5e-1385-4330-811f-86bf83e679db req-3de929da-ecc0-4f98-9ed4-a60783a69541 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:12.224299 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b0082c5e-1385-4330-811f-86bf83e679db req-3de929da-ecc0-4f98-9ed4-a60783a69541 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:12.253777 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-b0082c5e-1385-4330-811f-86bf83e679db req-3de929da-ecc0-4f98-9ed4-a60783a69541 service nova] Creating event network-vif-plugged:607c5562-f08b-4306-b2bb-feb8a3b27cd2 for instance 949ced75-d278-4a85-aea5-b14c6a8c672e on hv-cinder-79578 May 18 17:19:12.260644 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-b0082c5e-1385-4330-811f-86bf83e679db req-3de929da-ecc0-4f98-9ed4-a60783a69541 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071276 May 18 17:19:12.266224 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 510/1004] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:19:12.579334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:12.602091 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1d816290-662a-48f4-a00e-b79355f55b03 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:12.610786 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:12.618542 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1d816290-662a-48f4-a00e-b79355f55b03 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1313 microversion: 2.1 time: 0.447304 May 18 17:19:12.619508 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 495/1005] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:12 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1313 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:13.632440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:13.641187 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1de16e2b-4963-4c7f-aa3f-4857f9b7ee46 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:13.643235 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1de16e2b-4963-4c7f-aa3f-4857f9b7ee46 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:13.657732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1de16e2b-4963-4c7f-aa3f-4857f9b7ee46 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:13.660713 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1de16e2b-4963-4c7f-aa3f-4857f9b7ee46 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:13.661553 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1de16e2b-4963-4c7f-aa3f-4857f9b7ee46 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:13.662028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1de16e2b-4963-4c7f-aa3f-4857f9b7ee46 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:13.890530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-1de16e2b-4963-4c7f-aa3f-4857f9b7ee46 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:13.898567 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1de16e2b-4963-4c7f-aa3f-4857f9b7ee46 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1313 microversion: 2.1 time: 0.267091 May 18 17:19:13.899148 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 511/1006] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:13 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:14.327675 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bfc061eb-7990-4975-a26e-b29e460cd5dd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:14.328737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bfc061eb-7990-4975-a26e-b29e460cd5dd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:14.336526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bfc061eb-7990-4975-a26e-b29e460cd5dd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:14.336970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bfc061eb-7990-4975-a26e-b29e460cd5dd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:14.337807 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bfc061eb-7990-4975-a26e-b29e460cd5dd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:14.338427 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bfc061eb-7990-4975-a26e-b29e460cd5dd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:14.371387 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bfc061eb-7990-4975-a26e-b29e460cd5dd tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047856 May 18 17:19:14.387291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 496/1007] 10.222.0.49 () {60 vars in 1342 bytes} [Wed May 18 17:19:14 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:14.435955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-9e2fd547-8cf1-4195-a41f-aa337c5bf5ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:14.436805 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9e2fd547-8cf1-4195-a41f-aa337c5bf5ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:14.445331 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9e2fd547-8cf1-4195-a41f-aa337c5bf5ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:14.446011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9e2fd547-8cf1-4195-a41f-aa337c5bf5ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:14.446938 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9e2fd547-8cf1-4195-a41f-aa337c5bf5ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:14.447530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-9e2fd547-8cf1-4195-a41f-aa337c5bf5ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:14.482676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-9e2fd547-8cf1-4195-a41f-aa337c5bf5ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:19:14.576048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-9e2fd547-8cf1-4195-a41f-aa337c5bf5ea tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 204 len: 0 microversion: 2.20 time: 0.144317 May 18 17:19:14.577800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 512/1008] 10.222.0.49 () {60 vars in 1279 bytes} [Wed May 18 17:19:14 2022] DELETE /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 17:19:14.588785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:14.589886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:14.599093 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:14.599866 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:14.601054 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:14.601508 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:14.916629 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6851474a-f964-4a4e-9d15-a20b48d3d766 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:14.918149 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6851474a-f964-4a4e-9d15-a20b48d3d766 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:14.925382 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6851474a-f964-4a4e-9d15-a20b48d3d766 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:14.926130 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6851474a-f964-4a4e-9d15-a20b48d3d766 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:14.927019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6851474a-f964-4a4e-9d15-a20b48d3d766 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:14.927559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6851474a-f964-4a4e-9d15-a20b48d3d766 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:15.105194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:15.115607 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:15.117190 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:15.118667 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4d119e8b-b8f5-4309-9a08-0b16a350b1f3 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.535674 May 18 17:19:15.119625 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 497/1009] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:19:14 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:19:15.168052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-6851474a-f964-4a4e-9d15-a20b48d3d766 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:15.178694 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6851474a-f964-4a4e-9d15-a20b48d3d766 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1497 microversion: 2.1 time: 0.266690 May 18 17:19:15.179583 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 513/1010] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:14 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1497 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:19:15.772546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-050b3d5e-27b7-456e-87a3-35b9458ef72f tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:15.773223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-050b3d5e-27b7-456e-87a3-35b9458ef72f tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:15.785051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-050b3d5e-27b7-456e-87a3-35b9458ef72f tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:15.790047 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-050b3d5e-27b7-456e-87a3-35b9458ef72f tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:15.791531 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-050b3d5e-27b7-456e-87a3-35b9458ef72f tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:15.791984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-050b3d5e-27b7-456e-87a3-35b9458ef72f tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:15.825342 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-050b3d5e-27b7-456e-87a3-35b9458ef72f tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:19:15.931940 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-050b3d5e-27b7-456e-87a3-35b9458ef72f tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 204 len: 0 microversion: 2.1 time: 0.167645 May 18 17:19:15.933788 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 498/1011] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:19:15 2022] DELETE /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:19:15.942935 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-02a1be75-6401-4417-9a61-ff5ea5d21c80 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:15.943586 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-02a1be75-6401-4417-9a61-ff5ea5d21c80 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:15.953250 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02a1be75-6401-4417-9a61-ff5ea5d21c80 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:15.953755 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02a1be75-6401-4417-9a61-ff5ea5d21c80 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:15.954755 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02a1be75-6401-4417-9a61-ff5ea5d21c80 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:15.955210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-02a1be75-6401-4417-9a61-ff5ea5d21c80 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:16.139038 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:16.140171 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:16.146795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:16.147585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:16.148582 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:16.149235 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:16.197764 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-02a1be75-6401-4417-9a61-ff5ea5d21c80 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:16.207834 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-02a1be75-6401-4417-9a61-ff5ea5d21c80 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1503 microversion: 2.1 time: 0.269800 May 18 17:19:16.212666 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 514/1012] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:15 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1503 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:19:16.396833 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:16.405494 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:16.407584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:16.409187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-96f9f864-3c28-470b-bc8f-7b94d66c50e1 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.274435 May 18 17:19:16.421992 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 499/1013] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:19:16 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 18 17:19:17.235371 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-78fd6354-47e1-49ae-b4e0-0234324a23d4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:17.236047 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-78fd6354-47e1-49ae-b4e0-0234324a23d4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:17.251016 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-78fd6354-47e1-49ae-b4e0-0234324a23d4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:17.253639 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-78fd6354-47e1-49ae-b4e0-0234324a23d4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:17.256934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-78fd6354-47e1-49ae-b4e0-0234324a23d4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:17.257558 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-78fd6354-47e1-49ae-b4e0-0234324a23d4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:17.374989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:19:17.375238 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Wed May 18 17:19:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e (ip 10.222.0.49) !!! May 18 17:19:17.428593 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:17.431102 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:17.457981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:17.463635 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:17.463815 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:17.464257 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:17.614344 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-78fd6354-47e1-49ae-b4e0-0234324a23d4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:17.624203 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-78fd6354-47e1-49ae-b4e0-0234324a23d4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1503 microversion: 2.1 time: 0.397881 May 18 17:19:17.633916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 515/1014] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:17 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1503 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:18.137108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:18.147256 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:18.155748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:18.160994 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-56756511-e5a4-496c-b365-d379cea40412 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1723 microversion: 2.20 time: 0.735941 May 18 17:19:18.163586 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 500/1015] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:19:17 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1723 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:19:18.645120 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4e19f630-7f75-4973-9ce6-2a16a76baf9a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:18.645804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4e19f630-7f75-4973-9ce6-2a16a76baf9a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:18.652386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e19f630-7f75-4973-9ce6-2a16a76baf9a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:18.653084 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e19f630-7f75-4973-9ce6-2a16a76baf9a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:18.654088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e19f630-7f75-4973-9ce6-2a16a76baf9a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:18.654935 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4e19f630-7f75-4973-9ce6-2a16a76baf9a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:18.789510 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-8416fcb8-8b79-4503-a9f1-dce501a85ff9 req-b02842b8-686d-4efd-960e-1eb1261d2159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "949ced75-d278-4a85-aea5-b14c6a8c672e", "name": "network-vif-deleted", "tag": "607c5562-f08b-4306-b2bb-feb8a3b27cd2"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:18.813533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-8416fcb8-8b79-4503-a9f1-dce501a85ff9 req-b02842b8-686d-4efd-960e-1eb1261d2159 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:18.814436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-8416fcb8-8b79-4503-a9f1-dce501a85ff9 req-b02842b8-686d-4efd-960e-1eb1261d2159 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:18.828126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4e19f630-7f75-4973-9ce6-2a16a76baf9a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:18.837775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4e19f630-7f75-4973-9ce6-2a16a76baf9a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 200 len: 1298 microversion: 2.1 time: 0.196427 May 18 17:19:18.838826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-8416fcb8-8b79-4503-a9f1-dce501a85ff9 req-b02842b8-686d-4efd-960e-1eb1261d2159 service nova] Creating event network-vif-deleted:607c5562-f08b-4306-b2bb-feb8a3b27cd2 for instance 949ced75-d278-4a85-aea5-b14c6a8c672e on hv-cinder-79578 May 18 17:19:18.839136 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 501/1016] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:18 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 1298 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:18.849452 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-8416fcb8-8b79-4503-a9f1-dce501a85ff9 req-b02842b8-686d-4efd-960e-1eb1261d2159 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.277348 May 18 17:19:18.850757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 516/1017] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:19.187663 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:19.188292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:19.197516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:19.198105 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:19.198838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:19.199272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:19.312045 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:19.324407 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:19.326666 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '13b9ab17cee74e8282cd86a37eaf19aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fe001ad764a40839c0a87e48dedb14f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:19.328722 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-31667a21-78a3-46ec-a8f0-693a9ec860d9 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 200 len: 1657 microversion: 2.20 time: 0.148383 May 18 17:19:19.329286 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 502/1018] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:19:19 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 1657 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 18 17:19:19.674622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-57f59561-caf1-44fc-b448-36939a12336a req-394607c9-f57f-4318-a521-f983bd7d54ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f53e5299-6ac2-4849-a4c1-01924709ff00", "name": "network-vif-deleted", "tag": "47bc87df-78ea-4da7-8fdc-bd2bd4b75078"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:19.698936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-57f59561-caf1-44fc-b448-36939a12336a req-394607c9-f57f-4318-a521-f983bd7d54ee service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:19.700533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-57f59561-caf1-44fc-b448-36939a12336a req-394607c9-f57f-4318-a521-f983bd7d54ee service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:19.742878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-57f59561-caf1-44fc-b448-36939a12336a req-394607c9-f57f-4318-a521-f983bd7d54ee service nova] Creating event network-vif-deleted:47bc87df-78ea-4da7-8fdc-bd2bd4b75078 for instance f53e5299-6ac2-4849-a4c1-01924709ff00 on hv-cinder-79578 May 18 17:19:19.753451 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-57f59561-caf1-44fc-b448-36939a12336a req-394607c9-f57f-4318-a521-f983bd7d54ee service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085415 May 18 17:19:19.755436 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 517/1019] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:19.856087 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:19.857337 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: 949ced75-d278-4a85-aea5-b14c6a8c672e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:19.870501 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:19.871881 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:19.872978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:19.873596 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:19.895347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] HTTP exception thrown: Instance 949ced75-d278-4a85-aea5-b14c6a8c672e could not be found. May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Request method failure captured: May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e HTTP/1.1 May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSqETg0tLJKtK0mnP9Ayn3Oegosgh571BScG6FMPAjhRpMnwcQCgwmt42M9qjfnPwlAl4xAkfdmS2SNtexHXsC4GpBDuexeRkwk-gJZOOCEY0HFDegp9C6gFL62hr7Ko8BIjrQUIrTlv1ATTTymVErARYJ8vjES5gqUZe3kzSHhPty8 May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 73a1d41bf5e24b54972ce29acb4b11a2 May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesActionsTest-1645585090 May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:19:19.897307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/73a1d41bf5e24b54972ce29acb4b11a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_73a1d41bf5e24b54972ce29acb4b11a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/73a1d41bf5e24b54972ce29acb4b11a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/73a1d41bf5e24b54972ce29acb4b11a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesActionsTest-1645585090 May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 73a1d41bf5e24b54972ce29acb4b11a2 May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesActionsTest-1645585090 May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesActionsTest-1645585090-project May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: ae6e9f34c1e0408bac7c252f9ecdd7e7 May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesActionsTest-1645585090-project May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 949ced75-d278-4a85-aea5-b14c6a8c672e could not be found. May 18 17:19:19.900034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '949ced75-d278-4a85-aea5-b14c6a8c672e'} May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 949ced75-d278-4a85-aea5-b14c6a8c672e could not be found. May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:19.901519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 949ced75-d278-4a85-aea5-b14c6a8c672e could not be found. May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 949ced75-d278-4a85-aea5-b14c6a8c672e could not be found. May 18 17:19:19.906841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:19.911756 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Returning 404 to user: Instance 949ced75-d278-4a85-aea5-b14c6a8c672e could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:19.911756 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2b398e0f-7534-489a-8e5e-a65674d5ceb4 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e" status: 404 len: 111 microversion: 2.1 time: 0.047016 May 18 17:19:19.914917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 503/1020] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:19 2022] GET /compute/v2.1/servers/949ced75-d278-4a85-aea5-b14c6a8c672e => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:19:20.068648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-398402416", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "networks": [{"uuid": "3692996f-6f1c-4118-b653-236b372a2550"}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:20.135151 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] validate_networks() for [('3692996f-6f1c-4118-b653-236b372a2550', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:19:20.205765 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-60946364-cbaf-485e-ac51-f0fab292ce02 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Action: 'create', calling method: .version_select at 0x7feef3c328b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1878139194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL4/8a5IpztFqUfvv6D5loGBhz/0rNrTumXWIf0Ru0qFwgD008Ox3ifECpryWaK+yoEJ1qhImLxwWXMgVtmMNJ9OTMPtB7wHbnkWswu7Yy/g+gQBrxNM0ws0qws8/iC9nQ=="}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:20.250000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-60946364-cbaf-485e-ac51-f0fab292ce02 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Getting quotas for project 467c9f16c74546a68e59acbff2542cc2. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:19:20.257188 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-60946364-cbaf-485e-ac51-f0fab292ce02 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Getting quotas for user 53394412ea1f463196acd85c7e11621c and project 467c9f16c74546a68e59acbff2542cc2. Resources: {'key_pairs'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:19:20.273534 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR oslo.messaging._drivers.impl_rabbit [None req-60946364-cbaf-485e-ac51-f0fab292ce02 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [5ada04ec-5a40-4d8c-9801-9e23562c25e0] AMQP server on 10.222.0.49:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 18 17:19:20.586952 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:19:20.587443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:19:20.587981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:19:20.588452 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:19:20.588903 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:19:20.600979 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:20.601432 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:20.602781 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:20.603238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:20.622980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Getting quotas for project 73a1d41bf5e24b54972ce29acb4b11a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:19:20.627798 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Getting quotas for user ae6e9f34c1e0408bac7c252f9ecdd7e7 and project 73a1d41bf5e24b54972ce29acb4b11a2. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:19:20.639967 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:19:20.642820 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:19:20.692518 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c3968e8e-8a25-4c51-b345-527895df0142 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628547 May 18 17:19:20.698442 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 504/1021] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:19:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:19:20.703447 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:20.704060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:20.712135 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:20.712905 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:20.714075 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:20.714775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:20.731194 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] HTTP exception thrown: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Request method failure captured: May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 HTTP/1.1 May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSff22o0cI_fLCy985cFcaEiKyv8HxWqd1EtYKSXOCJSS_bGKFdKh5G5hfk7RekHwotcAC4D4YVMDvgVLJ19P67P8xNzeA3bBm8oEDgfFHY0ts2D-DUgVi984qmKZRgf9GXeU7aqa_FxVHyqmNvfmAoSIxTz11Qr1ZcXKjNk9B-sZuU May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Openstack-Nova-Api-Version: 2.20 May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:19:20.732760 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 13b9ab17cee74e8282cd86a37eaf19aa May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:20.734608 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'f53e5299-6ac2-4849-a4c1-01924709ff00'} May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:20.735638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:20.738648 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:20.740061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Returning 404 to user: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:20.740061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b6197ce1-2162-4bf0-bde8-1bce38e90c77 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 404 len: 111 microversion: 2.20 time: 0.034816 May 18 17:19:20.740061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 505/1022] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:19:20 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 17:19:20.743166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-30b6f141-999a-47b6-8418-5563e1694b52 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:20.744028 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-30b6f141-999a-47b6-8418-5563e1694b52 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:20.803195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-30b6f141-999a-47b6-8418-5563e1694b52 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:20.810613 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-30b6f141-999a-47b6-8418-5563e1694b52 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1213 microversion: 2.1 time: 0.071182 May 18 17:19:20.811411 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 506/1023] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:20 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1213 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:20.816295 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4eefb3d6-9e1d-4837-998b-90654163887f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '.version_select at 0x7fef002100d0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:20.843019 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4eefb3d6-9e1d-4837-998b-90654163887f tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055811079" status: 204 len: 0 microversion: 2.20 time: 0.030262 May 18 17:19:20.844133 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 507/1024] 10.222.0.49 () {60 vars in 1261 bytes} [Wed May 18 17:19:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055811079 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 18 17:19:21.284726 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [None req-60946364-cbaf-485e-ac51-f0fab292ce02 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [5ada04ec-5a40-4d8c-9801-9e23562c25e0] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 37442. May 18 17:19:21.306142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-60946364-cbaf-485e-ac51-f0fab292ce02 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.244135 May 18 17:19:21.306690 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 518/1025] 10.222.0.49 () {60 vars in 1158 bytes} [Wed May 18 17:19:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:21.834002 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1c386f37-fe34-48e4-8a87-1e32c1a03d81 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:21.834571 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1c386f37-fe34-48e4-8a87-1e32c1a03d81 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:21.924069 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1c386f37-fe34-48e4-8a87-1e32c1a03d81 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:21.932002 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1c386f37-fe34-48e4-8a87-1e32c1a03d81 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1213 microversion: 2.1 time: 0.107502 May 18 17:19:21.933832 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 508/1026] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:21 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:22.837829 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:22.838480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:22.847376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:22.847827 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:22.848692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:22.849181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:22.864945 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] HTTP exception thrown: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Request method failure captured: May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 HTTP/1.1 May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSff22o0cI_fLCy985cFcaEiKyv8HxWqd1EtYKSXOCJSS_bGKFdKh5G5hfk7RekHwotcAC4D4YVMDvgVLJ19P67P8xNzeA3bBm8oEDgfFHY0ts2D-DUgVi984qmKZRgf9GXeU7aqa_FxVHyqmNvfmAoSIxTz11Qr1ZcXKjNk9B-sZuU May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Openstack-Nova-Api-Version: 2.20 May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:19:22.866668 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 13b9ab17cee74e8282cd86a37eaf19aa May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.868395 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': 'f53e5299-6ac2-4849-a4c1-01924709ff00'} May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:22.869477 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.871032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:22.873407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Returning 404 to user: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:22.873407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-70ca6b7f-5b84-4d8b-acfc-129e3414b780 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "DELETE /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 404 len: 111 microversion: 2.20 time: 0.037018 May 18 17:19:22.873407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 519/1027] 10.222.0.49 () {60 vars in 1279 bytes} [Wed May 18 17:19:22 2022] DELETE /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 17:19:22.880437 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:22.881223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: f53e5299-6ac2-4849-a4c1-01924709ff00] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:22.887947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:22.888479 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:22.889379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:22.889858 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:22.904328 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] HTTP exception thrown: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Request method failure captured: May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 HTTP/1.1 May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSff22o0cI_fLCy985cFcaEiKyv8HxWqd1EtYKSXOCJSS_bGKFdKh5G5hfk7RekHwotcAC4D4YVMDvgVLJ19P67P8xNzeA3bBm8oEDgfFHY0ts2D-DUgVi984qmKZRgf9GXeU7aqa_FxVHyqmNvfmAoSIxTz11Qr1ZcXKjNk9B-sZuU May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Openstack-Nova-Api-Version: 2.20 May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:19:22.906103 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 13b9ab17cee74e8282cd86a37eaf19aa May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.907761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'f53e5299-6ac2-4849-a4c1-01924709ff00'} May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:22.911728 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. May 18 17:19:22.913308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:22.914642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Returning 404 to user: Instance f53e5299-6ac2-4849-a4c1-01924709ff00 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:22.914642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-beac59bc-905c-4b68-a11b-e1b2b3a23248 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00" status: 404 len: 111 microversion: 2.20 time: 0.034487 May 18 17:19:22.914642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 509/1028] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:19:22 2022] GET /compute/v2.1/servers/f53e5299-6ac2-4849-a4c1-01924709ff00 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 18 17:19:22.956366 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-90a758df-6c28-418c-addb-69efe30434b3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:22.958043 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-90a758df-6c28-418c-addb-69efe30434b3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:23.037031 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-90a758df-6c28-418c-addb-69efe30434b3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:23.045352 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-90a758df-6c28-418c-addb-69efe30434b3 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1213 microversion: 2.1 time: 0.097096 May 18 17:19:23.046584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 520/1029] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:22 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1213 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:24.066681 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e55c55dc-f2a1-4a21-b561-7c400c90d9de tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:24.067315 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e55c55dc-f2a1-4a21-b561-7c400c90d9de tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:24.125205 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e55c55dc-f2a1-4a21-b561-7c400c90d9de tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:24.130497 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:24.131046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:24.135165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e55c55dc-f2a1-4a21-b561-7c400c90d9de tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1213 microversion: 2.1 time: 0.073195 May 18 17:19:24.135822 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 510/1030] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:24 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:24.137880 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:24.138329 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:24.139097 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:24.139690 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] HTTP exception thrown: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Request method failure captured: May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 HTTP/1.1 May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSff22o0cI_fLCy985cFcaEiKyv8HxWqd1EtYKSXOCJSS_bGKFdKh5G5hfk7RekHwotcAC4D4YVMDvgVLJ19P67P8xNzeA3bBm8oEDgfFHY0ts2D-DUgVi984qmKZRgf9GXeU7aqa_FxVHyqmNvfmAoSIxTz11Qr1ZcXKjNk9B-sZuU May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Openstack-Nova-Api-Version: 2.20 May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:19:24.158622 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 13b9ab17cee74e8282cd86a37eaf19aa May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.160533 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': 'e9559237-c858-41a6-ba99-09106ba78496'} May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:24.162000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.163487 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:24.164957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Returning 404 to user: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:24.164957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ce47d36a-50b0-47b6-a2f2-91715421e978 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 404 len: 111 microversion: 2.20 time: 0.033981 May 18 17:19:24.164957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 521/1031] 10.222.0.49 () {60 vars in 1279 bytes} [Wed May 18 17:19:24 2022] DELETE /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 18 17:19:24.168123 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:24.168637 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] [instance: e9559237-c858-41a6-ba99-09106ba78496] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:24.175244 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:24.175692 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:24.176476 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:24.176916 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:24.191186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] HTTP exception thrown: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Request method failure captured: May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 HTTP/1.1 May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSff22o0cI_fLCy985cFcaEiKyv8HxWqd1EtYKSXOCJSS_bGKFdKh5G5hfk7RekHwotcAC4D4YVMDvgVLJ19P67P8xNzeA3bBm8oEDgfFHY0ts2D-DUgVi984qmKZRgf9GXeU7aqa_FxVHyqmNvfmAoSIxTz11Qr1ZcXKjNk9B-sZuU May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Openstack-Nova-Api-Version: 2.20 May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:19:24.192936 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/6fe001ad764a40839c0a87e48dedb14f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 6fe001ad764a40839c0a87e48dedb14f May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1995712859 May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 13b9ab17cee74e8282cd86a37eaf19aa May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1995712859-project May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.194718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'e9559237-c858-41a6-ba99-09106ba78496'} May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:24.195573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. May 18 17:19:24.197039 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:24.198922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] Returning 404 to user: Instance e9559237-c858-41a6-ba99-09106ba78496 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:24.198922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2ac5e52d-bb6d-499b-a8f6-877c152ccad0 tempest-AttachVolumeShelveTestJSON-1995712859 tempest-AttachVolumeShelveTestJSON-1995712859-project] 10.222.0.49 "GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496" status: 404 len: 111 microversion: 2.20 time: 0.031356 May 18 17:19:24.198922 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 511/1032] 10.222.0.49 () {60 vars in 1276 bytes} [Wed May 18 17:19:24 2022] GET /compute/v2.1/servers/e9559237-c858-41a6-ba99-09106ba78496 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 18 17:19:25.152834 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-69c2a2f1-8c68-43b9-954c-dd2a89832198 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:25.153473 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-69c2a2f1-8c68-43b9-954c-dd2a89832198 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:25.162077 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69c2a2f1-8c68-43b9-954c-dd2a89832198 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:25.162850 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69c2a2f1-8c68-43b9-954c-dd2a89832198 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:25.163655 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69c2a2f1-8c68-43b9-954c-dd2a89832198 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:25.164094 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69c2a2f1-8c68-43b9-954c-dd2a89832198 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:25.468866 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-69c2a2f1-8c68-43b9-954c-dd2a89832198 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:25.477763 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-69c2a2f1-8c68-43b9-954c-dd2a89832198 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1217 microversion: 2.1 time: 0.328698 May 18 17:19:25.482987 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 522/1033] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:25 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1217 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:26.502931 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-88ad50c1-edfe-41ef-ae49-fc2c18bf6166 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:26.502931 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-88ad50c1-edfe-41ef-ae49-fc2c18bf6166 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:26.508472 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88ad50c1-edfe-41ef-ae49-fc2c18bf6166 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:26.508935 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88ad50c1-edfe-41ef-ae49-fc2c18bf6166 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:26.509825 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88ad50c1-edfe-41ef-ae49-fc2c18bf6166 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:26.510307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88ad50c1-edfe-41ef-ae49-fc2c18bf6166 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:26.634062 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-88ad50c1-edfe-41ef-ae49-fc2c18bf6166 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:26.645020 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-88ad50c1-edfe-41ef-ae49-fc2c18bf6166 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1271 microversion: 2.1 time: 0.153289 May 18 17:19:26.645908 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 512/1034] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:26 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:27.669547 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3ea35182-2960-4814-9be8-ea3d5f6f8bfd tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:27.670761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3ea35182-2960-4814-9be8-ea3d5f6f8bfd tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:27.681306 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ea35182-2960-4814-9be8-ea3d5f6f8bfd tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:27.683527 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ea35182-2960-4814-9be8-ea3d5f6f8bfd tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:27.684559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ea35182-2960-4814-9be8-ea3d5f6f8bfd tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:27.685117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3ea35182-2960-4814-9be8-ea3d5f6f8bfd tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:27.860411 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3ea35182-2960-4814-9be8-ea3d5f6f8bfd tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:27.868407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3ea35182-2960-4814-9be8-ea3d5f6f8bfd tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.208451 May 18 17:19:27.869048 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 523/1035] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:27 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:28.501917 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-4ca7b2de-e419-4ac9-8235-3f52d3fc04db req-df4458be-6451-4ab8-bc5b-a5d37a37886f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1612d7d-7394-4fb3-a285-61ee08781e35", "tag": "4c3c95bc-c0eb-4bb7-ba36-fe217cd18221"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:28.514758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-4ca7b2de-e419-4ac9-8235-3f52d3fc04db req-df4458be-6451-4ab8-bc5b-a5d37a37886f service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:28.516252 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-4ca7b2de-e419-4ac9-8235-3f52d3fc04db req-df4458be-6451-4ab8-bc5b-a5d37a37886f service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:28.534274 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-4ca7b2de-e419-4ac9-8235-3f52d3fc04db req-df4458be-6451-4ab8-bc5b-a5d37a37886f service nova] Creating event network-changed:4c3c95bc-c0eb-4bb7-ba36-fe217cd18221 for instance e1612d7d-7394-4fb3-a285-61ee08781e35 on hv-cinder-79578 May 18 17:19:28.539587 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-4ca7b2de-e419-4ac9-8235-3f52d3fc04db req-df4458be-6451-4ab8-bc5b-a5d37a37886f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041984 May 18 17:19:28.541028 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 513/1036] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:28.887279 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-730fde0e-b1c8-4900-a7d2-2f23486b2f14 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:28.888823 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-730fde0e-b1c8-4900-a7d2-2f23486b2f14 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:28.895496 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-730fde0e-b1c8-4900-a7d2-2f23486b2f14 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:28.895943 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-730fde0e-b1c8-4900-a7d2-2f23486b2f14 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:28.896761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-730fde0e-b1c8-4900-a7d2-2f23486b2f14 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:28.897480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-730fde0e-b1c8-4900-a7d2-2f23486b2f14 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:29.054428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-730fde0e-b1c8-4900-a7d2-2f23486b2f14 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:29.062362 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-730fde0e-b1c8-4900-a7d2-2f23486b2f14 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.178856 May 18 17:19:29.072661 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 524/1037] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:28 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:29.731157 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1710148e-49ec-41fe-b2fa-e0cc6f67a78f tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Action: 'create', calling method: .version_select at 0x7fef001fd670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1184019249"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:30.030084 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1710148e-49ec-41fe-b2fa-e0cc6f67a78f tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.425414 May 18 17:19:30.030788 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 514/1038] 10.222.0.49 () {60 vars in 1154 bytes} [Wed May 18 17:19:29 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 427 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 18 17:19:30.041830 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4c121d95-08b7-4921-9c13-5e3dd7804da9 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3bf2dc0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:30.081694 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-47a4f1f1-e9ea-43bb-83bd-5b5e505040eb tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:30.082661 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-47a4f1f1-e9ea-43bb-83bd-5b5e505040eb tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:30.088951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-47a4f1f1-e9ea-43bb-83bd-5b5e505040eb tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:30.089406 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-47a4f1f1-e9ea-43bb-83bd-5b5e505040eb tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:30.090261 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-47a4f1f1-e9ea-43bb-83bd-5b5e505040eb tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:30.090702 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-47a4f1f1-e9ea-43bb-83bd-5b5e505040eb tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:30.095761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4c121d95-08b7-4921-9c13-5e3dd7804da9 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60" status: 200 len: 345 microversion: 2.1 time: 0.057730 May 18 17:19:30.096433 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 525/1039] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:19:30 2022] GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:30.098519 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:30.236810 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-47a4f1f1-e9ea-43bb-83bd-5b5e505040eb tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:30.244335 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-47a4f1f1-e9ea-43bb-83bd-5b5e505040eb tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.167753 May 18 17:19:30.244896 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 515/1040] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:30 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:19:31.109059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a38713e6-5039-4e6f-8c99-ab5db94d815d tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3bc5ee0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:31.156469 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a38713e6-5039-4e6f-8c99-ab5db94d815d tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60" status: 200 len: 346 microversion: 2.1 time: 0.051682 May 18 17:19:31.157182 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 526/1041] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:19:31 2022] GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:19:31.170770 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2f842612-447f-43a5-8470-91e5e1e7f871 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Action: 'create', calling method: .version_select at 0x7fef00444d30>, body: {"snapshot": {"volume_id": "511e9ab2-48d5-4435-9534-7c0ff7122f60", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-464503375"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:31.178435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:31.263581 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3b923726-ca2f-499b-83e4-87fb56559d5d tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:31.264618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3b923726-ca2f-499b-83e4-87fb56559d5d tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:31.273253 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b923726-ca2f-499b-83e4-87fb56559d5d tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:31.273910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b923726-ca2f-499b-83e4-87fb56559d5d tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:31.274733 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b923726-ca2f-499b-83e4-87fb56559d5d tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:31.275400 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3b923726-ca2f-499b-83e4-87fb56559d5d tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:31.349307 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2f842612-447f-43a5-8470-91e5e1e7f871 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.182091 May 18 17:19:31.358948 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 516/1042] 10.222.0.49 () {60 vars in 1161 bytes} [Wed May 18 17:19:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:31.369146 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4352da50-c47e-4a42-8795-2782cea8d310 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7fef006ce550>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:31.409621 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4352da50-c47e-4a42-8795-2782cea8d310 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.044003 May 18 17:19:31.410386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 517/1043] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:31 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:31.421683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5f37ddb3-5c24-401f-aa69-206d993ec914 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7fef00471310>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:31.437241 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3b923726-ca2f-499b-83e4-87fb56559d5d tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:31.445691 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3b923726-ca2f-499b-83e4-87fb56559d5d tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.187580 May 18 17:19:31.446293 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 527/1044] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:31 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:31.453700 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5f37ddb3-5c24-401f-aa69-206d993ec914 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.036512 May 18 17:19:31.454267 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 518/1045] 10.222.0.49 () {58 vars in 1139 bytes} [Wed May 18 17:19:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:19:31.465535 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c4eb51e8-abbb-437a-a9cc-d21ce4d0f2c1 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3bc5e50>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:31.496337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c4eb51e8-abbb-437a-a9cc-d21ce4d0f2c1 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.034823 May 18 17:19:31.496976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 528/1046] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:31 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:32.463811 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-17cee6d1-1803-4880-b9ca-ab7588a33094 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:32.464416 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-17cee6d1-1803-4880-b9ca-ab7588a33094 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:32.466366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:32.473190 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-17cee6d1-1803-4880-b9ca-ab7588a33094 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:32.473643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-17cee6d1-1803-4880-b9ca-ab7588a33094 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:32.474486 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-17cee6d1-1803-4880-b9ca-ab7588a33094 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:32.475032 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-17cee6d1-1803-4880-b9ca-ab7588a33094 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:32.510162 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-164032f0-0ddd-4924-9412-9c27240cc6c4 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3b5c3a0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:32.542735 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-164032f0-0ddd-4924-9412-9c27240cc6c4 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.038302 May 18 17:19:32.543321 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 529/1047] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:32 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:19:32.630549 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-17cee6d1-1803-4880-b9ca-ab7588a33094 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:32.638161 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-17cee6d1-1803-4880-b9ca-ab7588a33094 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.178691 May 18 17:19:32.638769 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 519/1048] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:32 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:33.551411 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:33.556087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c623ac5c-a00c-4b76-870b-f45e95d2f013 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3bf24c0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:33.588215 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c623ac5c-a00c-4b76-870b-f45e95d2f013 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.037341 May 18 17:19:33.589035 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 530/1049] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:33 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:33.655785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-50b64ba7-e1cb-4283-8b7a-d476cacc9697 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:33.656503 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-50b64ba7-e1cb-4283-8b7a-d476cacc9697 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:33.665532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-50b64ba7-e1cb-4283-8b7a-d476cacc9697 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:33.666136 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-50b64ba7-e1cb-4283-8b7a-d476cacc9697 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:33.666974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-50b64ba7-e1cb-4283-8b7a-d476cacc9697 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:33.667419 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-50b64ba7-e1cb-4283-8b7a-d476cacc9697 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:33.803801 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-50b64ba7-e1cb-4283-8b7a-d476cacc9697 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:33.811354 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-50b64ba7-e1cb-4283-8b7a-d476cacc9697 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.159598 May 18 17:19:33.811919 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 520/1050] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:33 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:34.600530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f19fcdef-8dfc-412a-9025-e671b0ad48df tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3b5c0d0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:34.633119 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f19fcdef-8dfc-412a-9025-e671b0ad48df tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.036969 May 18 17:19:34.633725 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 531/1051] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:34 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:34.828942 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c14c5ebf-8248-401e-bb25-3ee716248610 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:34.830308 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c14c5ebf-8248-401e-bb25-3ee716248610 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:34.832803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=12 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:34.839055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c14c5ebf-8248-401e-bb25-3ee716248610 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:34.839513 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c14c5ebf-8248-401e-bb25-3ee716248610 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:34.840291 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c14c5ebf-8248-401e-bb25-3ee716248610 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:34.840738 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c14c5ebf-8248-401e-bb25-3ee716248610 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:34.997889 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c14c5ebf-8248-401e-bb25-3ee716248610 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:35.006610 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c14c5ebf-8248-401e-bb25-3ee716248610 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.181522 May 18 17:19:35.007704 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 521/1052] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:34 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:19:35.647262 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a593383a-20a0-4872-a66f-97e47e1e088e tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3bc5b80>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:35.680059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a593383a-20a0-4872-a66f-97e47e1e088e tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.038429 May 18 17:19:35.680636 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 532/1053] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:35 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:36.024118 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fe840db2-c7d6-4219-be6a-87eb1bf3d638 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:36.024697 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fe840db2-c7d6-4219-be6a-87eb1bf3d638 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:36.032274 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe840db2-c7d6-4219-be6a-87eb1bf3d638 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:36.032717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe840db2-c7d6-4219-be6a-87eb1bf3d638 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:36.033897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe840db2-c7d6-4219-be6a-87eb1bf3d638 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:36.034343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fe840db2-c7d6-4219-be6a-87eb1bf3d638 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:36.176205 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fe840db2-c7d6-4219-be6a-87eb1bf3d638 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:36.183990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fe840db2-c7d6-4219-be6a-87eb1bf3d638 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.163723 May 18 17:19:36.184574 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 522/1054] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:36 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:36.698997 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-63f0a4cb-8f0b-4247-b0ba-b2b5b11596aa tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3bc5940>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:36.737219 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-63f0a4cb-8f0b-4247-b0ba-b2b5b11596aa tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.048956 May 18 17:19:36.737842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 533/1055] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:36 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:37.201315 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-88ae113f-f201-447e-92f9-d1eddd5071fa tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:37.201978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-88ae113f-f201-447e-92f9-d1eddd5071fa tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:37.208945 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88ae113f-f201-447e-92f9-d1eddd5071fa tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:37.209388 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88ae113f-f201-447e-92f9-d1eddd5071fa tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:37.210178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88ae113f-f201-447e-92f9-d1eddd5071fa tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:37.210609 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-88ae113f-f201-447e-92f9-d1eddd5071fa tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:37.342638 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-88ae113f-f201-447e-92f9-d1eddd5071fa tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:37.350991 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-88ae113f-f201-447e-92f9-d1eddd5071fa tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.153494 May 18 17:19:37.351561 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 523/1056] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:37 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:37.749264 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-06640fb6-431c-4ba9-8598-1692c5551166 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3a57040>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:37.778045 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-06640fb6-431c-4ba9-8598-1692c5551166 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.032915 May 18 17:19:37.779386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 534/1057] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:37 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:38.368092 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3ce4f3b4-c2c6-4902-abae-3f8e78bb3a3c tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:38.368706 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3ce4f3b4-c2c6-4902-abae-3f8e78bb3a3c tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:38.375576 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ce4f3b4-c2c6-4902-abae-3f8e78bb3a3c tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:38.376522 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ce4f3b4-c2c6-4902-abae-3f8e78bb3a3c tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:38.377351 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ce4f3b4-c2c6-4902-abae-3f8e78bb3a3c tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:38.377850 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3ce4f3b4-c2c6-4902-abae-3f8e78bb3a3c tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:38.518476 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3ce4f3b4-c2c6-4902-abae-3f8e78bb3a3c tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:38.526019 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3ce4f3b4-c2c6-4902-abae-3f8e78bb3a3c tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.162130 May 18 17:19:38.526595 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 524/1058] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:38 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:38.791663 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a3b2f6c7-e01d-430f-80fd-04bc058f7f31 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3a9ff70>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:38.825557 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a3b2f6c7-e01d-430f-80fd-04bc058f7f31 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 287 microversion: 2.1 time: 0.038287 May 18 17:19:38.826410 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 535/1059] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:38 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:38.838561 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b4ff90db-b120-4ce8-975e-7fe4635155ab tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7fef0049a790>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:38.913306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b4ff90db-b120-4ce8-975e-7fe4635155ab tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "DELETE /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 202 len: 0 microversion: 2.1 time: 0.079446 May 18 17:19:38.914023 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 525/1060] 10.222.0.49 () {58 vars in 1253 bytes} [Wed May 18 17:19:38 2022] DELETE /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 18 17:19:38.923079 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a65a3ae7-3ecb-4e45-8973-be42d0ed28cc tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3b480d0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:38.952906 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a65a3ae7-3ecb-4e45-8973-be42d0ed28cc tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 200 len: 286 microversion: 2.1 time: 0.033670 May 18 17:19:38.953472 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 536/1061] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:38 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:39.543477 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e95779b9-3850-4944-bb60-c3115292b847 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:39.544097 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e95779b9-3850-4944-bb60-c3115292b847 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:39.550633 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e95779b9-3850-4944-bb60-c3115292b847 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:39.551077 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e95779b9-3850-4944-bb60-c3115292b847 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:39.551830 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e95779b9-3850-4944-bb60-c3115292b847 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:39.552263 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e95779b9-3850-4944-bb60-c3115292b847 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:39.684673 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e95779b9-3850-4944-bb60-c3115292b847 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:39.692868 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e95779b9-3850-4944-bb60-c3115292b847 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.153685 May 18 17:19:39.693418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 526/1062] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:39 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:39.966228 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-568a31cc-deb5-4a63-b4d5-ff027bc92bd3 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3b5c1f0>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:39.992052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-568a31cc-deb5-4a63-b4d5-ff027bc92bd3 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] HTTP exception thrown: Snapshot fd6cd897-39b7-49e7-8db3-a7fb05728217 could not be found. May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-568a31cc-deb5-4a63-b4d5-ff027bc92bd3 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Request method failure captured: May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 HTTP/1.1 May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSqhM_lM2JZGNsQxQViGwVA-3gJfjpQbu8hSSdXQjxxgBkLcVtZXfn3joc95D9uEtcdb_WYwC1p7Sl6riEiBy0mCt5ujZfNmp5GPw5F2xpYihrSsMHKKTiiNz4bWvr-SQfm2muFYKkFlXU3Ja-F_e2iTuh1LstbY0G3PHZzVt01-wEQ May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 0225c1c1f1de442690d4c2436b2f921d May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:19:40.010055 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 0225c1c1f1de442690d4c2436b2f921d May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesSnapshotsTestJSON-1985943674-project May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: ec95176d98aa407195ea9eb98cea3968 May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1985943674-project May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Snapshot fd6cd897-39b7-49e7-8db3-a7fb05728217 could not be found. May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': 'fd6cd897-39b7-49e7-8db3-a7fb05728217'} May 18 17:19:40.012318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fd6cd897-39b7-49e7-8db3-a7fb05728217 could not be found. (HTTP 404) (Request-ID: req-edbbe271-faa5-4d47-abae-3baf719f2b1a) May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:40.013346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:19:40.014772 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fd6cd897-39b7-49e7-8db3-a7fb05728217 could not be found. May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 18 17:19:40.016559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fd6cd897-39b7-49e7-8db3-a7fb05728217 could not be found. May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fd6cd897-39b7-49e7-8db3-a7fb05728217 could not be found. May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-568a31cc-deb5-4a63-b4d5-ff027bc92bd3 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Returning 404 to user: Snapshot fd6cd897-39b7-49e7-8db3-a7fb05728217 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:40.017959 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-568a31cc-deb5-4a63-b4d5-ff027bc92bd3 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217" status: 404 len: 111 microversion: 2.1 time: 0.049765 May 18 17:19:40.018950 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 537/1063] 10.222.0.49 () {58 vars in 1250 bytes} [Wed May 18 17:19:39 2022] GET /compute/v2.1/os-snapshots/fd6cd897-39b7-49e7-8db3-a7fb05728217 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:19:40.021201 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-77a41129-95e1-4079-86a3-97031a532ea1 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7fef004d7af0>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:40.082543 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-77a41129-95e1-4079-86a3-97031a532ea1 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60" status: 202 len: 0 microversion: 2.1 time: 0.065459 May 18 17:19:40.083108 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 527/1064] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:19:40 2022] DELETE /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:19:40.091309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-644ae3a9-b2a8-4b53-890c-8e5c02309e49 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3f72f70>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:40.140032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-644ae3a9-b2a8-4b53-890c-8e5c02309e49 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60" status: 200 len: 345 microversion: 2.1 time: 0.052440 May 18 17:19:40.140617 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 538/1065] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:19:40 2022] GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:40.710114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5b8be8fd-7061-406c-a26d-19f94f6dd64b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:40.710675 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5b8be8fd-7061-406c-a26d-19f94f6dd64b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:40.717152 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b8be8fd-7061-406c-a26d-19f94f6dd64b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:40.717600 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b8be8fd-7061-406c-a26d-19f94f6dd64b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:40.718653 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b8be8fd-7061-406c-a26d-19f94f6dd64b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:40.719088 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5b8be8fd-7061-406c-a26d-19f94f6dd64b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:40.863889 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5b8be8fd-7061-406c-a26d-19f94f6dd64b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:40.872376 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5b8be8fd-7061-406c-a26d-19f94f6dd64b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.166708 May 18 17:19:40.872964 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 528/1066] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:40 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:40.900963 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-b9ba075c-87b1-4064-9c35-4faf9bb0e555 req-f33285cc-cd90-44b1-bcd7-6f6d45e113cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1612d7d-7394-4fb3-a285-61ee08781e35", "name": "network-vif-plugged", "status": "completed", "tag": "4c3c95bc-c0eb-4bb7-ba36-fe217cd18221"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:40.904658 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:40.911664 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b9ba075c-87b1-4064-9c35-4faf9bb0e555 req-f33285cc-cd90-44b1-bcd7-6f6d45e113cf service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:40.912108 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-b9ba075c-87b1-4064-9c35-4faf9bb0e555 req-f33285cc-cd90-44b1-bcd7-6f6d45e113cf service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:40.916859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:40.926138 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-b9ba075c-87b1-4064-9c35-4faf9bb0e555 req-f33285cc-cd90-44b1-bcd7-6f6d45e113cf service nova] Creating event network-vif-plugged:4c3c95bc-c0eb-4bb7-ba36-fe217cd18221 for instance e1612d7d-7394-4fb3-a285-61ee08781e35 on hv-cinder-79578 May 18 17:19:40.933393 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-b9ba075c-87b1-4064-9c35-4faf9bb0e555 req-f33285cc-cd90-44b1-bcd7-6f6d45e113cf service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036209 May 18 17:19:40.934026 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 539/1067] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:41.152901 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a8326931-3410-42db-8137-f76c540f7d13 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7fef00507d30>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:41.182624 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-a8326931-3410-42db-8137-f76c540f7d13 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] HTTP exception thrown: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a8326931-3410-42db-8137-f76c540f7d13 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Request method failure captured: May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 HTTP/1.1 May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSqhM_lM2JZGNsQxQViGwVA-3gJfjpQbu8hSSdXQjxxgBkLcVtZXfn3joc95D9uEtcdb_WYwC1p7Sl6riEiBy0mCt5ujZfNmp5GPw5F2xpYihrSsMHKKTiiNz4bWvr-SQfm2muFYKkFlXU3Ja-F_e2iTuh1LstbY0G3PHZzVt01-wEQ May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0225c1c1f1de442690d4c2436b2f921d May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:19:41.184707 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0225c1c1f1de442690d4c2436b2f921d May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesSnapshotsTestJSON-1985943674-project May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: ec95176d98aa407195ea9eb98cea3968 May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1985943674-project May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '511e9ab2-48d5-4435-9534-7c0ff7122f60'} May 18 17:19:41.186389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. (HTTP 404) (Request-ID: req-a4742f4b-7be1-4cf1-9c3b-1c365b35a2ff) May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.187266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:19:41.188950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 17:19:41.190199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-a8326931-3410-42db-8137-f76c540f7d13 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Returning 404 to user: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-a8326931-3410-42db-8137-f76c540f7d13 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60" status: 404 len: 109 microversion: 2.1 time: 0.037245 May 18 17:19:41.191491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 529/1068] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:19:41 2022] GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:19:41.203178 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f7b5972e-d41c-4326-accd-0692d7a6c8b7 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7feef3c32820>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:41.242038 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-f7b5972e-d41c-4326-accd-0692d7a6c8b7 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] HTTP exception thrown: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f7b5972e-d41c-4326-accd-0692d7a6c8b7 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Request method failure captured: May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 HTTP/1.1 May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSqhM_lM2JZGNsQxQViGwVA-3gJfjpQbu8hSSdXQjxxgBkLcVtZXfn3joc95D9uEtcdb_WYwC1p7Sl6riEiBy0mCt5ujZfNmp5GPw5F2xpYihrSsMHKKTiiNz4bWvr-SQfm2muFYKkFlXU3Ja-F_e2iTuh1LstbY0G3PHZzVt01-wEQ May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 0225c1c1f1de442690d4c2436b2f921d May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:19:41.244595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 0225c1c1f1de442690d4c2436b2f921d May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesSnapshotsTestJSON-1985943674-project May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: ec95176d98aa407195ea9eb98cea3968 May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1985943674-project May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '511e9ab2-48d5-4435-9534-7c0ff7122f60'} May 18 17:19:41.246024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. (HTTP 404) (Request-ID: req-d06b8a4c-2520-47f3-aa7a-bcf8d91d2310) May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.246844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 18 17:19:41.248052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 18 17:19:41.249211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f7b5972e-d41c-4326-accd-0692d7a6c8b7 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Returning 404 to user: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:41.250409 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f7b5972e-d41c-4326-accd-0692d7a6c8b7 tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "DELETE /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60" status: 404 len: 109 microversion: 2.1 time: 0.048567 May 18 17:19:41.251711 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 540/1069] 10.222.0.49 () {58 vars in 1247 bytes} [Wed May 18 17:19:41 2022] DELETE /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:19:41.255372 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-652bfb2f-9f91-4ffb-9fbf-6d9f6710a0bc tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Calling method '.version_select at 0x7fef00507790>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:41.283823 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-652bfb2f-9f91-4ffb-9fbf-6d9f6710a0bc tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] HTTP exception thrown: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-652bfb2f-9f91-4ffb-9fbf-6d9f6710a0bc tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Request method failure captured: May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 HTTP/1.1 May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSqhM_lM2JZGNsQxQViGwVA-3gJfjpQbu8hSSdXQjxxgBkLcVtZXfn3joc95D9uEtcdb_WYwC1p7Sl6riEiBy0mCt5ujZfNmp5GPw5F2xpYihrSsMHKKTiiNz4bWvr-SQfm2muFYKkFlXU3Ja-F_e2iTuh1LstbY0G3PHZzVt01-wEQ May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 0225c1c1f1de442690d4c2436b2f921d May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:19:41.285821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/0225c1c1f1de442690d4c2436b2f921d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 0225c1c1f1de442690d4c2436b2f921d May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1985943674 May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesSnapshotsTestJSON-1985943674-project May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: ec95176d98aa407195ea9eb98cea3968 May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1985943674-project May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '511e9ab2-48d5-4435-9534-7c0ff7122f60'} May 18 17:19:41.287443 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. (HTTP 404) (Request-ID: req-3919af96-a6fb-4aa4-ac0d-06c35d6d14bb) May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.288424 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi item = cinderclient( May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 18 17:19:41.289886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 18 17:19:41.291296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-652bfb2f-9f91-4ffb-9fbf-6d9f6710a0bc tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] Returning 404 to user: Volume 511e9ab2-48d5-4435-9534-7c0ff7122f60 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-652bfb2f-9f91-4ffb-9fbf-6d9f6710a0bc tempest-VolumesSnapshotsTestJSON-1985943674 tempest-VolumesSnapshotsTestJSON-1985943674-project] 10.222.0.49 "GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60" status: 404 len: 109 microversion: 2.1 time: 0.036309 May 18 17:19:41.292691 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 530/1070] 10.222.0.49 () {58 vars in 1244 bytes} [Wed May 18 17:19:41 2022] GET /compute/v2.1/os-volumes/511e9ab2-48d5-4435-9534-7c0ff7122f60 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:19:41.889991 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ee0ff3ca-1f05-4f63-b14b-418d1cd16bf6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:41.890716 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ee0ff3ca-1f05-4f63-b14b-418d1cd16bf6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:41.898300 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ee0ff3ca-1f05-4f63-b14b-418d1cd16bf6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:41.898763 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ee0ff3ca-1f05-4f63-b14b-418d1cd16bf6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:41.899598 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ee0ff3ca-1f05-4f63-b14b-418d1cd16bf6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:41.900065 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ee0ff3ca-1f05-4f63-b14b-418d1cd16bf6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:42.042980 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ee0ff3ca-1f05-4f63-b14b-418d1cd16bf6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:42.051693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ee0ff3ca-1f05-4f63-b14b-418d1cd16bf6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.166039 May 18 17:19:42.052418 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 541/1071] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:41 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:43.070035 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-33681bdd-d7da-4a12-a0f4-4dfe0b46e7fe tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:43.070653 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-33681bdd-d7da-4a12-a0f4-4dfe0b46e7fe tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:43.077099 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-33681bdd-d7da-4a12-a0f4-4dfe0b46e7fe tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:43.077572 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-33681bdd-d7da-4a12-a0f4-4dfe0b46e7fe tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:43.078404 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-33681bdd-d7da-4a12-a0f4-4dfe0b46e7fe tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:43.078865 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-33681bdd-d7da-4a12-a0f4-4dfe0b46e7fe tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:43.221368 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-33681bdd-d7da-4a12-a0f4-4dfe0b46e7fe tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:43.229213 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-33681bdd-d7da-4a12-a0f4-4dfe0b46e7fe tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1313 microversion: 2.1 time: 0.163537 May 18 17:19:43.229804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 531/1072] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:43 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:44.248240 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e32a0249-92ee-4f6f-9403-f7a55aba9f4a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:44.248858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e32a0249-92ee-4f6f-9403-f7a55aba9f4a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:44.256342 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e32a0249-92ee-4f6f-9403-f7a55aba9f4a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:44.256790 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e32a0249-92ee-4f6f-9403-f7a55aba9f4a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:44.257561 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e32a0249-92ee-4f6f-9403-f7a55aba9f4a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:44.258026 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e32a0249-92ee-4f6f-9403-f7a55aba9f4a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:44.399343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e32a0249-92ee-4f6f-9403-f7a55aba9f4a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:44.408796 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e32a0249-92ee-4f6f-9403-f7a55aba9f4a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1497 microversion: 2.1 time: 0.164070 May 18 17:19:44.409332 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 542/1073] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:44 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:45.029952 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-301a58e3-10e9-4d69-856d-a51b893ddf4b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:45.030581 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-301a58e3-10e9-4d69-856d-a51b893ddf4b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:45.037795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-301a58e3-10e9-4d69-856d-a51b893ddf4b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:45.038250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-301a58e3-10e9-4d69-856d-a51b893ddf4b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:45.039064 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-301a58e3-10e9-4d69-856d-a51b893ddf4b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:45.039508 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-301a58e3-10e9-4d69-856d-a51b893ddf4b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:45.068630 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-301a58e3-10e9-4d69-856d-a51b893ddf4b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:19:45.158181 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-301a58e3-10e9-4d69-856d-a51b893ddf4b tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "DELETE /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 204 len: 0 microversion: 2.1 time: 0.131289 May 18 17:19:45.158616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 532/1074] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:19:45 2022] DELETE /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:19:45.169113 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c49d66b1-4df9-4fe1-a64c-71f251ee56d6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:45.172336 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c49d66b1-4df9-4fe1-a64c-71f251ee56d6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:45.178976 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c49d66b1-4df9-4fe1-a64c-71f251ee56d6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:45.179615 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c49d66b1-4df9-4fe1-a64c-71f251ee56d6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:45.180423 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c49d66b1-4df9-4fe1-a64c-71f251ee56d6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:45.180896 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c49d66b1-4df9-4fe1-a64c-71f251ee56d6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:45.322114 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c49d66b1-4df9-4fe1-a64c-71f251ee56d6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:45.330597 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c49d66b1-4df9-4fe1-a64c-71f251ee56d6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1503 microversion: 2.1 time: 0.166184 May 18 17:19:45.331173 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 543/1075] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:45 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:46.349253 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-14253a41-8c7d-481a-b48d-7238ffb8a8b6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:46.350031 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-14253a41-8c7d-481a-b48d-7238ffb8a8b6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:46.356513 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14253a41-8c7d-481a-b48d-7238ffb8a8b6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:46.356959 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14253a41-8c7d-481a-b48d-7238ffb8a8b6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:46.357753 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14253a41-8c7d-481a-b48d-7238ffb8a8b6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:46.358294 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-14253a41-8c7d-481a-b48d-7238ffb8a8b6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:46.504801 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-14253a41-8c7d-481a-b48d-7238ffb8a8b6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:46.512420 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-14253a41-8c7d-481a-b48d-7238ffb8a8b6 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1503 microversion: 2.1 time: 0.168012 May 18 17:19:46.518155 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 533/1076] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:46 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:47.530497 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c9d25eec-577a-4940-83bc-1c5812afe25a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:47.531102 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c9d25eec-577a-4940-83bc-1c5812afe25a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:47.538097 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9d25eec-577a-4940-83bc-1c5812afe25a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:47.538545 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9d25eec-577a-4940-83bc-1c5812afe25a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:47.539320 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9d25eec-577a-4940-83bc-1c5812afe25a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:47.539756 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9d25eec-577a-4940-83bc-1c5812afe25a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:47.618354 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c9d25eec-577a-4940-83bc-1c5812afe25a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae6e9f34c1e0408bac7c252f9ecdd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73a1d41bf5e24b54972ce29acb4b11a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:47.627275 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c9d25eec-577a-4940-83bc-1c5812afe25a tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 200 len: 1461 microversion: 2.1 time: 0.100647 May 18 17:19:47.627856 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 544/1077] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:47 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 1461 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:47.659490 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-108a3584-a5cc-48b9-a561-f40bc533f634 req-284a0fbb-d188-4363-a367-7aa8dcaebb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1612d7d-7394-4fb3-a285-61ee08781e35", "name": "network-vif-deleted", "tag": "4c3c95bc-c0eb-4bb7-ba36-fe217cd18221"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:47.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-108a3584-a5cc-48b9-a561-f40bc533f634 req-284a0fbb-d188-4363-a367-7aa8dcaebb03 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:47.671888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-108a3584-a5cc-48b9-a561-f40bc533f634 req-284a0fbb-d188-4363-a367-7aa8dcaebb03 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:47.683925 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-108a3584-a5cc-48b9-a561-f40bc533f634 req-284a0fbb-d188-4363-a367-7aa8dcaebb03 service nova] Creating event network-vif-deleted:4c3c95bc-c0eb-4bb7-ba36-fe217cd18221 for instance e1612d7d-7394-4fb3-a285-61ee08781e35 on hv-cinder-79578 May 18 17:19:47.689553 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-108a3584-a5cc-48b9-a561-f40bc533f634 req-284a0fbb-d188-4363-a367-7aa8dcaebb03 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034937 May 18 17:19:47.690552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 534/1078] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:48.644704 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:48.645316 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] [instance: e1612d7d-7394-4fb3-a285-61ee08781e35] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:48.651756 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:48.652202 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:48.652988 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:48.653451 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:48.667338 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] HTTP exception thrown: Instance e1612d7d-7394-4fb3-a285-61ee08781e35 could not be found. May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Request method failure captured: May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 HTTP/1.1 May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSqETg0tLJKtK0mnP9Ayn3Oegosgh571BScG6FMPAjhRpMnwcQCgwmt42M9qjfnPwlAl4xAkfdmS2SNtexHXsC4GpBDuexeRkwk-gJZOOCEY0HFDegp9C6gFL62hr7Ko8BIjrQUIrTlv1ATTTymVErARYJ8vjES5gqUZe3kzSHhPty8 May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 73a1d41bf5e24b54972ce29acb4b11a2 May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-VolumesActionsTest-1645585090 May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:19:48.668897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/73a1d41bf5e24b54972ce29acb4b11a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_73a1d41bf5e24b54972ce29acb4b11a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/73a1d41bf5e24b54972ce29acb4b11a2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/73a1d41bf5e24b54972ce29acb4b11a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-VolumesActionsTest-1645585090 May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 73a1d41bf5e24b54972ce29acb4b11a2 May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-VolumesActionsTest-1645585090 May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-VolumesActionsTest-1645585090-project May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: ae6e9f34c1e0408bac7c252f9ecdd7e7 May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-VolumesActionsTest-1645585090-project May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance e1612d7d-7394-4fb3-a285-61ee08781e35 could not be found. May 18 17:19:48.670509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': 'e1612d7d-7394-4fb3-a285-61ee08781e35'} May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1612d7d-7394-4fb3-a285-61ee08781e35 could not be found. May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:19:48.671428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1612d7d-7394-4fb3-a285-61ee08781e35 could not be found. May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1612d7d-7394-4fb3-a285-61ee08781e35 could not be found. May 18 17:19:48.673286 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:19:48.674682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] Returning 404 to user: Instance e1612d7d-7394-4fb3-a285-61ee08781e35 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:19:48.674682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c642dcb5-2be6-43bf-b055-4cb68bebede7 tempest-VolumesActionsTest-1645585090 tempest-VolumesActionsTest-1645585090-project] 10.222.0.49 "GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35" status: 404 len: 111 microversion: 2.1 time: 0.029685 May 18 17:19:48.674682 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 545/1079] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:48 2022] GET /compute/v2.1/servers/e1612d7d-7394-4fb3-a285-61ee08781e35 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:19:49.914379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2025129203", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1878139194", "security_groups": [{"name": "tempest-secgroup-smoke-178296769"}], "block_device_mapping_v2": [{"uuid": "e7743ed0-eaf0-44aa-9d0c-6d8f727e68fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3758902-7248-457c-ac74-050337304611"}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:50.034217 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] validate_networks() for [('d3758902-7248-457c-ac74-050337304611', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:19:50.432938 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:19:50.433432 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:19:50.434014 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:19:50.434644 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:19:50.435185 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:19:50.444573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:50.445121 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:50.446131 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:50.446718 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:50.464233 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Getting quotas for project 467c9f16c74546a68e59acbff2542cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:19:50.468312 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Getting quotas for user 53394412ea1f463196acd85c7e11621c and project 467c9f16c74546a68e59acbff2542cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:19:50.529958 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:19:50.532679 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7743ed0-eaf0-44aa-9d0c-6d8f727e68fe',volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:19:50.668837 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c63a7c15-55b6-4a8a-b9dc-4a9da7d4b99d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.759301 May 18 17:19:50.669493 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 535/1080] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:19:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:19:50.679841 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bec8026c-3e73-40ef-aa48-c6a8418657d0 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:50.680424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bec8026c-3e73-40ef-aa48-c6a8418657d0 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:50.738199 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bec8026c-3e73-40ef-aa48-c6a8418657d0 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:50.745119 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bec8026c-3e73-40ef-aa48-c6a8418657d0 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1095 microversion: 2.1 time: 0.069385 May 18 17:19:50.745902 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 546/1081] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:50 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:51.763270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-4ec8ffd6-ff2a-4299-b0f6-96e394d2aa5e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:51.763872 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-4ec8ffd6-ff2a-4299-b0f6-96e394d2aa5e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:51.771559 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ec8ffd6-ff2a-4299-b0f6-96e394d2aa5e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:51.772002 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ec8ffd6-ff2a-4299-b0f6-96e394d2aa5e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:51.772761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ec8ffd6-ff2a-4299-b0f6-96e394d2aa5e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:51.773195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-4ec8ffd6-ff2a-4299-b0f6-96e394d2aa5e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:51.834933 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-4ec8ffd6-ff2a-4299-b0f6-96e394d2aa5e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:51.842652 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-4ec8ffd6-ff2a-4299-b0f6-96e394d2aa5e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1145 microversion: 2.1 time: 0.083648 May 18 17:19:51.843226 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 536/1082] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:51 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:52.862698 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a6c4ab87-1d35-49f7-8ac0-8a516051c28a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:52.863268 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a6c4ab87-1d35-49f7-8ac0-8a516051c28a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:52.871367 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6c4ab87-1d35-49f7-8ac0-8a516051c28a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:52.871826 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6c4ab87-1d35-49f7-8ac0-8a516051c28a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:52.872614 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6c4ab87-1d35-49f7-8ac0-8a516051c28a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:52.873053 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a6c4ab87-1d35-49f7-8ac0-8a516051c28a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:52.944169 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a6c4ab87-1d35-49f7-8ac0-8a516051c28a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:52.951977 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a6c4ab87-1d35-49f7-8ac0-8a516051c28a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1137 microversion: 2.1 time: 0.095736 May 18 17:19:52.952757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 547/1083] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:52 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1137 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:53.972359 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ed3c2221-b734-417e-b587-68bd5fe72585 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:53.973254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ed3c2221-b734-417e-b587-68bd5fe72585 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:53.983477 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed3c2221-b734-417e-b587-68bd5fe72585 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:53.984069 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed3c2221-b734-417e-b587-68bd5fe72585 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:53.985078 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed3c2221-b734-417e-b587-68bd5fe72585 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:53.986388 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ed3c2221-b734-417e-b587-68bd5fe72585 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:54.071237 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ed3c2221-b734-417e-b587-68bd5fe72585 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:54.083700 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ed3c2221-b734-417e-b587-68bd5fe72585 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1211 microversion: 2.1 time: 0.117002 May 18 17:19:54.084289 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 537/1084] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:53 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:19:55.102425 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ac55341f-f070-4d71-a55c-2639246edc93 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:55.102962 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ac55341f-f070-4d71-a55c-2639246edc93 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:55.109843 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ac55341f-f070-4d71-a55c-2639246edc93 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:55.111332 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ac55341f-f070-4d71-a55c-2639246edc93 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:55.111905 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ac55341f-f070-4d71-a55c-2639246edc93 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:55.112351 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ac55341f-f070-4d71-a55c-2639246edc93 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:55.252878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ac55341f-f070-4d71-a55c-2639246edc93 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:55.260790 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ac55341f-f070-4d71-a55c-2639246edc93 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1278 microversion: 2.1 time: 0.162407 May 18 17:19:55.261364 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 548/1085] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:55 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:56.278646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-620496a3-4903-4467-a3e4-420c53c2ad59 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:56.279181 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-620496a3-4903-4467-a3e4-420c53c2ad59 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:56.285956 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-620496a3-4903-4467-a3e4-420c53c2ad59 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:56.286410 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-620496a3-4903-4467-a3e4-420c53c2ad59 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:56.287178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-620496a3-4903-4467-a3e4-420c53c2ad59 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:56.287616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-620496a3-4903-4467-a3e4-420c53c2ad59 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:56.305244 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:19:56.419720 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-620496a3-4903-4467-a3e4-420c53c2ad59 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:56.427469 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-620496a3-4903-4467-a3e4-420c53c2ad59 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1278 microversion: 2.1 time: 0.152747 May 18 17:19:56.428045 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 538/1086] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:56 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1278 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:57.445488 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3a23294b-6010-4309-9d32-aed6d6a1d76a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:57.446148 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3a23294b-6010-4309-9d32-aed6d6a1d76a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:57.452821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a23294b-6010-4309-9d32-aed6d6a1d76a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:57.453279 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a23294b-6010-4309-9d32-aed6d6a1d76a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:57.454842 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a23294b-6010-4309-9d32-aed6d6a1d76a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:57.455870 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3a23294b-6010-4309-9d32-aed6d6a1d76a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:57.595969 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3a23294b-6010-4309-9d32-aed6d6a1d76a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:57.604050 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3a23294b-6010-4309-9d32-aed6d6a1d76a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1278 microversion: 2.1 time: 0.162612 May 18 17:19:57.604610 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 549/1087] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:57 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1278 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:57.944514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-691a9828-cc36-402b-9865-5aa3ac713673 req-640b03ea-0b74-4860-be41-3b74a856b7c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6ed6b2-128c-48f2-a895-5729c9e0eda2", "tag": "811b811b-67d8-4153-9fae-a77d7dfb624f"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:19:57.973568 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-691a9828-cc36-402b-9865-5aa3ac713673 req-640b03ea-0b74-4860-be41-3b74a856b7c7 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:57.974371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-691a9828-cc36-402b-9865-5aa3ac713673 req-640b03ea-0b74-4860-be41-3b74a856b7c7 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:58.000326 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-691a9828-cc36-402b-9865-5aa3ac713673 req-640b03ea-0b74-4860-be41-3b74a856b7c7 service nova] Creating event network-changed:811b811b-67d8-4153-9fae-a77d7dfb624f for instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 on hv-cinder-79578 May 18 17:19:58.009757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-691a9828-cc36-402b-9865-5aa3ac713673 req-640b03ea-0b74-4860-be41-3b74a856b7c7 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073375 May 18 17:19:58.010785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 539/1088] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:19:58.622618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-089a8672-1075-49f0-81f5-16d67aa7986e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:58.623521 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-089a8672-1075-49f0-81f5-16d67aa7986e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:58.631405 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-089a8672-1075-49f0-81f5-16d67aa7986e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:58.631878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-089a8672-1075-49f0-81f5-16d67aa7986e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:58.632659 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-089a8672-1075-49f0-81f5-16d67aa7986e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:58.633313 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-089a8672-1075-49f0-81f5-16d67aa7986e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:58.885646 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-089a8672-1075-49f0-81f5-16d67aa7986e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:19:58.894248 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-089a8672-1075-49f0-81f5-16d67aa7986e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1278 microversion: 2.1 time: 0.275578 May 18 17:19:58.894822 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 550/1089] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:58 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:19:59.917937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7b870e6c-1e84-4e34-92c1-0c927619fc6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:19:59.922070 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7b870e6c-1e84-4e34-92c1-0c927619fc6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:19:59.933169 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b870e6c-1e84-4e34-92c1-0c927619fc6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:59.933771 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b870e6c-1e84-4e34-92c1-0c927619fc6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:19:59.934840 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b870e6c-1e84-4e34-92c1-0c927619fc6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:19:59.935407 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b870e6c-1e84-4e34-92c1-0c927619fc6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:00.090236 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7b870e6c-1e84-4e34-92c1-0c927619fc6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:00.100408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7b870e6c-1e84-4e34-92c1-0c927619fc6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1278 microversion: 2.1 time: 0.192294 May 18 17:20:00.100993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 540/1090] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:19:59 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1278 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:01.124091 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-69265b15-62ba-4eb5-80f3-bc5ebf74cce3 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:01.126383 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-69265b15-62ba-4eb5-80f3-bc5ebf74cce3 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:01.134163 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:01.138916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69265b15-62ba-4eb5-80f3-bc5ebf74cce3 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:01.139727 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69265b15-62ba-4eb5-80f3-bc5ebf74cce3 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:01.140846 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69265b15-62ba-4eb5-80f3-bc5ebf74cce3 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:01.141833 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-69265b15-62ba-4eb5-80f3-bc5ebf74cce3 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:01.358318 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-69265b15-62ba-4eb5-80f3-bc5ebf74cce3 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:01.403140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-69265b15-62ba-4eb5-80f3-bc5ebf74cce3 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.287425 May 18 17:20:01.407576 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 551/1091] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:01 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:02.421997 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3eb54760-02e3-4ac8-b2bb-2da2cec94209 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:02.423305 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3eb54760-02e3-4ac8-b2bb-2da2cec94209 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:02.425604 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:02.426410 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:02.440430 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3eb54760-02e3-4ac8-b2bb-2da2cec94209 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:02.442060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3eb54760-02e3-4ac8-b2bb-2da2cec94209 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:02.442899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3eb54760-02e3-4ac8-b2bb-2da2cec94209 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:02.443350 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3eb54760-02e3-4ac8-b2bb-2da2cec94209 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:02.663614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3eb54760-02e3-4ac8-b2bb-2da2cec94209 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:02.675893 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3eb54760-02e3-4ac8-b2bb-2da2cec94209 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.257568 May 18 17:20:02.676804 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 541/1092] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:02 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:03.695481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-32360cf8-a01a-45b0-8e86-f81146e324b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:03.696203 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-32360cf8-a01a-45b0-8e86-f81146e324b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:03.710202 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32360cf8-a01a-45b0-8e86-f81146e324b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:03.711383 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32360cf8-a01a-45b0-8e86-f81146e324b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:03.712391 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32360cf8-a01a-45b0-8e86-f81146e324b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:03.713049 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-32360cf8-a01a-45b0-8e86-f81146e324b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:03.881672 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-32360cf8-a01a-45b0-8e86-f81146e324b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:03.893328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-32360cf8-a01a-45b0-8e86-f81146e324b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.202972 May 18 17:20:03.894233 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 552/1093] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:03 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:04.927674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-846399f1-5a25-4ec0-841a-bbac743925c8 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:04.928425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-846399f1-5a25-4ec0-841a-bbac743925c8 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:04.935931 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:04.937824 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-846399f1-5a25-4ec0-841a-bbac743925c8 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:04.938523 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-846399f1-5a25-4ec0-841a-bbac743925c8 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:04.939552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-846399f1-5a25-4ec0-841a-bbac743925c8 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:04.940196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-846399f1-5a25-4ec0-841a-bbac743925c8 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:05.156498 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-846399f1-5a25-4ec0-841a-bbac743925c8 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:05.168013 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-846399f1-5a25-4ec0-841a-bbac743925c8 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.259854 May 18 17:20:05.178030 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 542/1094] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:04 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:06.186736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e85e6b60-a8a9-41b2-8ffa-0cdc8b0878e6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:06.189997 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e85e6b60-a8a9-41b2-8ffa-0cdc8b0878e6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:06.200599 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e85e6b60-a8a9-41b2-8ffa-0cdc8b0878e6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:06.201811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e85e6b60-a8a9-41b2-8ffa-0cdc8b0878e6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:06.204290 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e85e6b60-a8a9-41b2-8ffa-0cdc8b0878e6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:06.205794 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e85e6b60-a8a9-41b2-8ffa-0cdc8b0878e6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:06.382435 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e85e6b60-a8a9-41b2-8ffa-0cdc8b0878e6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:06.391975 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e85e6b60-a8a9-41b2-8ffa-0cdc8b0878e6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.210809 May 18 17:20:06.394198 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 553/1095] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:06 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:07.413726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-61b3e595-4a5e-4c42-b5f8-6cc0af5b7bcc tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:07.414939 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-61b3e595-4a5e-4c42-b5f8-6cc0af5b7bcc tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:07.425688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-61b3e595-4a5e-4c42-b5f8-6cc0af5b7bcc tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:07.426437 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-61b3e595-4a5e-4c42-b5f8-6cc0af5b7bcc tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:07.427812 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-61b3e595-4a5e-4c42-b5f8-6cc0af5b7bcc tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:07.428993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-61b3e595-4a5e-4c42-b5f8-6cc0af5b7bcc tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:07.613099 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-61b3e595-4a5e-4c42-b5f8-6cc0af5b7bcc tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:07.622364 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-61b3e595-4a5e-4c42-b5f8-6cc0af5b7bcc tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.215549 May 18 17:20:07.633803 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 543/1096] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:07 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:08.643454 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-202a46e3-53fe-4a12-a29e-8c0c0f07a37f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:08.644334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-202a46e3-53fe-4a12-a29e-8c0c0f07a37f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:08.670413 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-202a46e3-53fe-4a12-a29e-8c0c0f07a37f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:08.671610 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-202a46e3-53fe-4a12-a29e-8c0c0f07a37f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:08.673616 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-202a46e3-53fe-4a12-a29e-8c0c0f07a37f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:08.674710 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-202a46e3-53fe-4a12-a29e-8c0c0f07a37f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:09.082110 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-202a46e3-53fe-4a12-a29e-8c0c0f07a37f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:09.104161 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-202a46e3-53fe-4a12-a29e-8c0c0f07a37f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.466401 May 18 17:20:09.104761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 554/1097] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:08 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:10.122126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c89596fb-4fee-4ae0-824a-b685f7fed857 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:10.123414 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c89596fb-4fee-4ae0-824a-b685f7fed857 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:10.132931 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c89596fb-4fee-4ae0-824a-b685f7fed857 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:10.133758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c89596fb-4fee-4ae0-824a-b685f7fed857 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:10.134755 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c89596fb-4fee-4ae0-824a-b685f7fed857 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:10.135403 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c89596fb-4fee-4ae0-824a-b685f7fed857 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:10.290955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-078f4b1b-65ad-4d73-80ce-b9836f525923 req-dc0ab5d7-7235-4913-9f81-3eea2ca9d4b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6ed6b2-128c-48f2-a895-5729c9e0eda2", "name": "network-vif-plugged", "status": "completed", "tag": "811b811b-67d8-4153-9fae-a77d7dfb624f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:10.311872 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-078f4b1b-65ad-4d73-80ce-b9836f525923 req-dc0ab5d7-7235-4913-9f81-3eea2ca9d4b6 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:10.312320 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-078f4b1b-65ad-4d73-80ce-b9836f525923 req-dc0ab5d7-7235-4913-9f81-3eea2ca9d4b6 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:10.334508 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-078f4b1b-65ad-4d73-80ce-b9836f525923 req-dc0ab5d7-7235-4913-9f81-3eea2ca9d4b6 service nova] Creating event network-vif-plugged:811b811b-67d8-4153-9fae-a77d7dfb624f for instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 on hv-cinder-79578 May 18 17:20:10.343214 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-078f4b1b-65ad-4d73-80ce-b9836f525923 req-dc0ab5d7-7235-4913-9f81-3eea2ca9d4b6 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062873 May 18 17:20:10.344589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 555/1098] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:20:10.368314 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c89596fb-4fee-4ae0-824a-b685f7fed857 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:10.383357 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c89596fb-4fee-4ae0-824a-b685f7fed857 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.265068 May 18 17:20:10.393808 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 544/1099] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:10 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:11.402757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-64b08f71-16a9-4fe2-8235-7daf3141b985 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:11.404732 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-64b08f71-16a9-4fe2-8235-7daf3141b985 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:11.414442 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=34 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:11.418891 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64b08f71-16a9-4fe2-8235-7daf3141b985 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:11.419804 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64b08f71-16a9-4fe2-8235-7daf3141b985 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:11.420756 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64b08f71-16a9-4fe2-8235-7daf3141b985 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:11.421808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-64b08f71-16a9-4fe2-8235-7daf3141b985 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:11.457064 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=78 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:11.630143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-64b08f71-16a9-4fe2-8235-7daf3141b985 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:11.641560 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-64b08f71-16a9-4fe2-8235-7daf3141b985 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1266 microversion: 2.1 time: 0.240748 May 18 17:20:11.643159 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 556/1100] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:11 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1266 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:12.659916 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3688146f-4a2f-4970-b469-4fc8c407556b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:12.661228 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3688146f-4a2f-4970-b469-4fc8c407556b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:12.670569 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3688146f-4a2f-4970-b469-4fc8c407556b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:12.670569 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3688146f-4a2f-4970-b469-4fc8c407556b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:12.671061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3688146f-4a2f-4970-b469-4fc8c407556b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:12.671689 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3688146f-4a2f-4970-b469-4fc8c407556b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:12.849627 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3688146f-4a2f-4970-b469-4fc8c407556b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:12.861121 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3688146f-4a2f-4970-b469-4fc8c407556b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1452 microversion: 2.1 time: 0.205399 May 18 17:20:12.862578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 545/1101] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:12 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1452 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:12.878454 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3f3837c0-35e9-4169-ad80-3c45fd9855b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:12.879196 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3f3837c0-35e9-4169-ad80-3c45fd9855b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:12.886517 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3f3837c0-35e9-4169-ad80-3c45fd9855b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:12.887214 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3f3837c0-35e9-4169-ad80-3c45fd9855b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:12.888142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3f3837c0-35e9-4169-ad80-3c45fd9855b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:12.888733 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3f3837c0-35e9-4169-ad80-3c45fd9855b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:13.113075 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3f3837c0-35e9-4169-ad80-3c45fd9855b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:13.153969 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3f3837c0-35e9-4169-ad80-3c45fd9855b5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1452 microversion: 2.1 time: 0.279438 May 18 17:20:13.167628 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 557/1102] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:12 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1452 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:15.415839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cd0f4603-581d-4c0f-a288-11ccee189704 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-332003399"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:15.417018 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cd0f4603-581d-4c0f-a288-11ccee189704 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:15.424516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd0f4603-581d-4c0f-a288-11ccee189704 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:15.426511 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd0f4603-581d-4c0f-a288-11ccee189704 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:15.428167 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd0f4603-581d-4c0f-a288-11ccee189704 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:15.429537 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cd0f4603-581d-4c0f-a288-11ccee189704 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:15.669546 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.network.security_group_api [None req-cd0f4603-581d-4c0f-a288-11ccee189704 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Removing security group c67b20b0-285d-4882-9f8d-9b0b284118b7 from port 83599677-1718-443a-b9f2-afbf3863f167 May 18 17:20:15.676186 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-612cf5ef-8d39-49f6-b75f-8bff88b79447 req-6fe6d2a2-c688-44b0-bbf4-287918d81769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b6ed6b2-128c-48f2-a895-5729c9e0eda2", "tag": "811b811b-67d8-4153-9fae-a77d7dfb624f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:15.691602 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-612cf5ef-8d39-49f6-b75f-8bff88b79447 req-6fe6d2a2-c688-44b0-bbf4-287918d81769 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:15.692046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-612cf5ef-8d39-49f6-b75f-8bff88b79447 req-6fe6d2a2-c688-44b0-bbf4-287918d81769 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:15.716042 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-612cf5ef-8d39-49f6-b75f-8bff88b79447 req-6fe6d2a2-c688-44b0-bbf4-287918d81769 service nova] Creating event network-changed:811b811b-67d8-4153-9fae-a77d7dfb624f for instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 on hv-cinder-79578 May 18 17:20:15.730863 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-612cf5ef-8d39-49f6-b75f-8bff88b79447 req-6fe6d2a2-c688-44b0-bbf4-287918d81769 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058377 May 18 17:20:15.732146 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 558/1103] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:20:16.539555 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cd0f4603-581d-4c0f-a288-11ccee189704 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "POST /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/action" status: 202 len: 0 microversion: 2.1 time: 1.127529 May 18 17:20:16.541005 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 546/1104] 10.222.0.49 () {60 vars in 1277 bytes} [Wed May 18 17:20:15 2022] POST /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/action => generated 0 bytes in 1130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:20:16.562766 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-821b0d46-3f40-4f38-b45c-3e50276a2af1 req-512de953-31a6-428c-b024-c3fcbc70711c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749c046f-33ee-458b-a080-584bdbc4549a", "tag": "83599677-1718-443a-b9f2-afbf3863f167"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:16.581779 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-821b0d46-3f40-4f38-b45c-3e50276a2af1 req-512de953-31a6-428c-b024-c3fcbc70711c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:16.583353 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-821b0d46-3f40-4f38-b45c-3e50276a2af1 req-512de953-31a6-428c-b024-c3fcbc70711c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:16.617385 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-821b0d46-3f40-4f38-b45c-3e50276a2af1 req-512de953-31a6-428c-b024-c3fcbc70711c service nova] Creating event network-changed:83599677-1718-443a-b9f2-afbf3863f167 for instance 749c046f-33ee-458b-a080-584bdbc4549a on hv-cinder-79578 May 18 17:20:16.629191 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-821b0d46-3f40-4f38-b45c-3e50276a2af1 req-512de953-31a6-428c-b024-c3fcbc70711c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070472 May 18 17:20:16.629876 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 559/1105] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:20:18.517984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-986f81c7-10d0-4746-b4ed-1a1eeedf5e29 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:18.517984 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-986f81c7-10d0-4746-b4ed-1a1eeedf5e29 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:18.529548 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-986f81c7-10d0-4746-b4ed-1a1eeedf5e29 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:18.532187 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-986f81c7-10d0-4746-b4ed-1a1eeedf5e29 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:18.536060 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-986f81c7-10d0-4746-b4ed-1a1eeedf5e29 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:18.538729 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-986f81c7-10d0-4746-b4ed-1a1eeedf5e29 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:18.674539 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-ef8c9833-29d5-454d-8bc2-222c00767ca5 req-de122dc6-856b-4f01-893b-16be54fd2a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749c046f-33ee-458b-a080-584bdbc4549a", "tag": "83599677-1718-443a-b9f2-afbf3863f167"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:18.677114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-986f81c7-10d0-4746-b4ed-1a1eeedf5e29 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lazy-loading 'services' on Instance uuid 749c046f-33ee-458b-a080-584bdbc4549a {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:20:18.691572 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ef8c9833-29d5-454d-8bc2-222c00767ca5 req-de122dc6-856b-4f01-893b-16be54fd2a76 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:18.692037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-ef8c9833-29d5-454d-8bc2-222c00767ca5 req-de122dc6-856b-4f01-893b-16be54fd2a76 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:18.737305 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-ef8c9833-29d5-454d-8bc2-222c00767ca5 req-de122dc6-856b-4f01-893b-16be54fd2a76 service nova] Creating event network-changed:83599677-1718-443a-b9f2-afbf3863f167 for instance 749c046f-33ee-458b-a080-584bdbc4549a on hv-cinder-79578 May 18 17:20:18.748445 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-ef8c9833-29d5-454d-8bc2-222c00767ca5 req-de122dc6-856b-4f01-893b-16be54fd2a76 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079329 May 18 17:20:18.749892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 560/1106] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:20:18.805019 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-986f81c7-10d0-4746-b4ed-1a1eeedf5e29 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "DELETE /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments/b11ad840-0ff3-40c7-80ea-afc5b158ff21" status: 202 len: 0 microversion: 2.1 time: 0.290858 May 18 17:20:18.807620 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 547/1107] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:20:18 2022] DELETE /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments/b11ad840-0ff3-40c7-80ea-afc5b158ff21 => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:20:18.819949 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-22e34b98-ceec-46a3-8a6f-c732ca56a9d9 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:18.825397 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-22e34b98-ceec-46a3-8a6f-c732ca56a9d9 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:18.848249 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-22e34b98-ceec-46a3-8a6f-c732ca56a9d9 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:18.848719 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-22e34b98-ceec-46a3-8a6f-c732ca56a9d9 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:18.850785 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-22e34b98-ceec-46a3-8a6f-c732ca56a9d9 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:18.854280 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-22e34b98-ceec-46a3-8a6f-c732ca56a9d9 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:18.905433 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-22e34b98-ceec-46a3-8a6f-c732ca56a9d9 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092543 May 18 17:20:18.906927 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 561/1108] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:20:18 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:20:19.920743 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0b3e3316-7fde-46b6-89c0-376301840014 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:19.921876 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0b3e3316-7fde-46b6-89c0-376301840014 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:19.928807 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b3e3316-7fde-46b6-89c0-376301840014 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:19.929496 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b3e3316-7fde-46b6-89c0-376301840014 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:19.930398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b3e3316-7fde-46b6-89c0-376301840014 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:19.930768 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0b3e3316-7fde-46b6-89c0-376301840014 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:19.963516 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0b3e3316-7fde-46b6-89c0-376301840014 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048849 May 18 17:20:19.964227 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 548/1109] 10.222.0.49 () {58 vars in 1301 bytes} [Wed May 18 17:20:19 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 18 17:20:19.975234 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:19.975761 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:19.982151 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:19.982600 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:19.983370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:19.983825 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:20.064888 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] HTTP exception thrown: Instance 749c046f-33ee-458b-a080-584bdbc4549a is not attached to volume b11ad840-0ff3-40c7-80ea-afc5b158ff21 May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Request method failure captured: May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments/b11ad840-0ff3-40c7-80ea-afc5b158ff21 HTTP/1.1 May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSm3uQOts-r9usGg7d3PPIG0Ceefaq4w3D-KjLxj1AhFqTUbqYHsHeOrbEhq5OwpcJGg4hxI2V8P45k3mB6O-ZmCXBazIiTCsAoNfyjAvQNMSR3rFyuHRTjah3O0kBJY1wqnEwDfU_SXOj7SgcBAUVO6JneVZrumou1TdmvyfDVDWL0 May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: dd5a225077df40c6b99ae3e05740d44e May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-TestMinimumBasicScenario-483122096 May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:20:20.070309 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd5a225077df40c6b99ae3e05740d44e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd5a225077df40c6b99ae3e05740d44e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd5a225077df40c6b99ae3e05740d44e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd5a225077df40c6b99ae3e05740d44e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-TestMinimumBasicScenario-483122096 May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: dd5a225077df40c6b99ae3e05740d44e May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-TestMinimumBasicScenario-483122096 May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-TestMinimumBasicScenario-483122096-project May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 6b0deb40045e47cba7ed81b1ae6b528d May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-TestMinimumBasicScenario-483122096-project May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:20:20.072044 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 749c046f-33ee-458b-a080-584bdbc4549a is not attached to volume b11ad840-0ff3-40c7-80ea-afc5b158ff21 May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'server_id': '749c046f-33ee-458b-a080-584bdbc4549a', 'id': 'b11ad840-0ff3-40c7-80ea-afc5b158ff21'} May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id b11ad840-0ff3-40c7-80ea-afc5b158ff21. May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:20:20.072995 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749c046f-33ee-458b-a080-584bdbc4549a is not attached to volume b11ad840-0ff3-40c7-80ea-afc5b158ff21 May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749c046f-33ee-458b-a080-584bdbc4549a is not attached to volume b11ad840-0ff3-40c7-80ea-afc5b158ff21 May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:20.074632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Returning 404 to user: Instance 749c046f-33ee-458b-a080-584bdbc4549a is not attached to volume b11ad840-0ff3-40c7-80ea-afc5b158ff21 {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:20:20.075687 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f673d48d-5621-4596-a2cf-303e10fbcd63 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "DELETE /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments/b11ad840-0ff3-40c7-80ea-afc5b158ff21" status: 404 len: 154 microversion: 2.1 time: 0.100770 May 18 17:20:20.075687 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 562/1110] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:20:19 2022] DELETE /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a/os-volume_attachments/b11ad840-0ff3-40c7-80ea-afc5b158ff21 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:20:22.267189 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7913fae3-19b1-45cc-b2fe-a1ebdb58f5dc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:22.267855 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7913fae3-19b1-45cc-b2fe-a1ebdb58f5dc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:22.275043 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7913fae3-19b1-45cc-b2fe-a1ebdb58f5dc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:22.275499 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7913fae3-19b1-45cc-b2fe-a1ebdb58f5dc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:22.276268 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7913fae3-19b1-45cc-b2fe-a1ebdb58f5dc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:22.276710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7913fae3-19b1-45cc-b2fe-a1ebdb58f5dc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:22.303113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7913fae3-19b1-45cc-b2fe-a1ebdb58f5dc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:20:22.385771 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7913fae3-19b1-45cc-b2fe-a1ebdb58f5dc tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "DELETE /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 204 len: 0 microversion: 2.1 time: 0.122450 May 18 17:20:22.386420 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 549/1111] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:20:22 2022] DELETE /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:20:22.395953 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-196dc274-2a84-4828-b8e6-1136df91e948 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:22.396897 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-196dc274-2a84-4828-b8e6-1136df91e948 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:22.403195 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-196dc274-2a84-4828-b8e6-1136df91e948 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:22.403637 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-196dc274-2a84-4828-b8e6-1136df91e948 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:22.404402 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-196dc274-2a84-4828-b8e6-1136df91e948 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:22.404839 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-196dc274-2a84-4828-b8e6-1136df91e948 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:22.549742 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-196dc274-2a84-4828-b8e6-1136df91e948 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:22.562077 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-196dc274-2a84-4828-b8e6-1136df91e948 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1552 microversion: 2.1 time: 0.170706 May 18 17:20:22.563588 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 563/1112] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:22 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1552 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:23.582672 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1174018b-73b2-4dd5-9ba7-353a057592d0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:23.583604 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1174018b-73b2-4dd5-9ba7-353a057592d0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:23.590322 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1174018b-73b2-4dd5-9ba7-353a057592d0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:23.590761 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1174018b-73b2-4dd5-9ba7-353a057592d0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:23.591565 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1174018b-73b2-4dd5-9ba7-353a057592d0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:23.592151 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1174018b-73b2-4dd5-9ba7-353a057592d0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:23.744352 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1174018b-73b2-4dd5-9ba7-353a057592d0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:23.756953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1174018b-73b2-4dd5-9ba7-353a057592d0 tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1552 microversion: 2.1 time: 0.179372 May 18 17:20:23.757841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 550/1113] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:23 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1552 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:24.782858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-3bc7de2c-cc56-4def-8712-433710c37ffd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:24.783274 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-3bc7de2c-cc56-4def-8712-433710c37ffd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:24.794754 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bc7de2c-cc56-4def-8712-433710c37ffd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:24.795219 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bc7de2c-cc56-4def-8712-433710c37ffd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:24.796007 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bc7de2c-cc56-4def-8712-433710c37ffd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:24.796453 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-3bc7de2c-cc56-4def-8712-433710c37ffd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:25.080445 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-3bc7de2c-cc56-4def-8712-433710c37ffd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6b0deb40045e47cba7ed81b1ae6b528d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd5a225077df40c6b99ae3e05740d44e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:25.089697 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-3bc7de2c-cc56-4def-8712-433710c37ffd tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 200 len: 1552 microversion: 2.1 time: 0.311910 May 18 17:20:25.100549 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 564/1114] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:24 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 1552 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:25.384686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-a4094760-cc27-4718-a3d7-2504dd88f933 req-581cac08-636a-4981-adc3-74cfd9383e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749c046f-33ee-458b-a080-584bdbc4549a", "name": "network-vif-deleted", "tag": "83599677-1718-443a-b9f2-afbf3863f167"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:25.398293 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-a4094760-cc27-4718-a3d7-2504dd88f933 req-581cac08-636a-4981-adc3-74cfd9383e57 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:25.398726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-a4094760-cc27-4718-a3d7-2504dd88f933 req-581cac08-636a-4981-adc3-74cfd9383e57 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:25.412365 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-a4094760-cc27-4718-a3d7-2504dd88f933 req-581cac08-636a-4981-adc3-74cfd9383e57 service nova] Creating event network-vif-deleted:83599677-1718-443a-b9f2-afbf3863f167 for instance 749c046f-33ee-458b-a080-584bdbc4549a on hv-cinder-79578 May 18 17:20:25.418238 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-a4094760-cc27-4718-a3d7-2504dd88f933 req-581cac08-636a-4981-adc3-74cfd9383e57 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037901 May 18 17:20:25.418832 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 551/1115] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:20:26.106934 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:26.107491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] [instance: 749c046f-33ee-458b-a080-584bdbc4549a] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:26.114263 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:26.114714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:26.115531 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:26.115965 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:26.129740 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] HTTP exception thrown: Instance 749c046f-33ee-458b-a080-584bdbc4549a could not be found. May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Request method failure captured: May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a HTTP/1.1 May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSm3uQOts-r9usGg7d3PPIG0Ceefaq4w3D-KjLxj1AhFqTUbqYHsHeOrbEhq5OwpcJGg4hxI2V8P45k3mB6O-ZmCXBazIiTCsAoNfyjAvQNMSR3rFyuHRTjah3O0kBJY1wqnEwDfU_SXOj7SgcBAUVO6JneVZrumou1TdmvyfDVDWL0 May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: dd5a225077df40c6b99ae3e05740d44e May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-TestMinimumBasicScenario-483122096 May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:20:26.131258 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd5a225077df40c6b99ae3e05740d44e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_dd5a225077df40c6b99ae3e05740d44e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/dd5a225077df40c6b99ae3e05740d44e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/dd5a225077df40c6b99ae3e05740d44e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-TestMinimumBasicScenario-483122096 May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: dd5a225077df40c6b99ae3e05740d44e May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-TestMinimumBasicScenario-483122096 May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-TestMinimumBasicScenario-483122096-project May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 6b0deb40045e47cba7ed81b1ae6b528d May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-TestMinimumBasicScenario-483122096-project May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 749c046f-33ee-458b-a080-584bdbc4549a could not be found. May 18 17:20:26.132910 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '749c046f-33ee-458b-a080-584bdbc4549a'} May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749c046f-33ee-458b-a080-584bdbc4549a could not be found. May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:20:26.133718 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749c046f-33ee-458b-a080-584bdbc4549a could not be found. May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749c046f-33ee-458b-a080-584bdbc4549a could not be found. May 18 17:20:26.135494 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:20:26.137085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Returning 404 to user: Instance 749c046f-33ee-458b-a080-584bdbc4549a could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:20:26.137085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-45284a54-d728-49d0-8c5b-548736311dea tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a" status: 404 len: 111 microversion: 2.1 time: 0.029748 May 18 17:20:26.137085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 565/1116] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:26 2022] GET /compute/v2.1/servers/749c046f-33ee-458b-a080-584bdbc4549a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:20:26.142877 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-eb8f2e4f-9cb9-403d-97d0-ee4a6694c22b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] Calling method '.version_select at 0x7fef004aea60>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:26.162579 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-eb8f2e4f-9cb9-403d-97d0-ee4a6694c22b tempest-TestMinimumBasicScenario-483122096 tempest-TestMinimumBasicScenario-483122096-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-414767752" status: 202 len: 0 microversion: 2.1 time: 0.024371 May 18 17:20:26.163776 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 552/1117] 10.222.0.49 () {58 vars in 1268 bytes} [Wed May 18 17:20:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-414767752 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:20:26.638446 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-724835761", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "networks": [{"uuid": "b291bd50-0e61-424f-bfff-6e6d91c827e9"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:26.764185 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] validate_networks() for [('b291bd50-0e61-424f-bfff-6e6d91c827e9', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:20:27.747326 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:20:27.747917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:20:27.748442 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:20:27.748887 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:20:27.749322 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:20:27.763878 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:27.764408 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:27.766545 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:27.767183 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:27.793989 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Getting quotas for project 746b5a83a469465cbd94f8f9dfa0db94. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:20:27.799269 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Getting quotas for user f654d7139eea497591637bf43fc418f5 and project 746b5a83a469465cbd94f8f9dfa0db94. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:20:27.814586 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:20:27.817143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:20:27.867177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-1efbf66e-bc5c-40bd-a268-32f29bba03aa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233196 May 18 17:20:27.868047 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 566/1118] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:20:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:20:27.879003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d59f25c3-520f-42a9-8c4e-ec523f1adc89 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:27.880460 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d59f25c3-520f-42a9-8c4e-ec523f1adc89 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:27.944040 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d59f25c3-520f-42a9-8c4e-ec523f1adc89 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:27.951379 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d59f25c3-520f-42a9-8c4e-ec523f1adc89 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1218 microversion: 2.1 time: 0.077452 May 18 17:20:27.957961 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 553/1119] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:27 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:28.970320 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-4811fe8b-956d-4ad5-9e04-65bf6b87e893 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:28.971681 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-4811fe8b-956d-4ad5-9e04-65bf6b87e893 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:28.980818 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4811fe8b-956d-4ad5-9e04-65bf6b87e893 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:28.981268 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4811fe8b-956d-4ad5-9e04-65bf6b87e893 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:28.982140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4811fe8b-956d-4ad5-9e04-65bf6b87e893 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:28.982977 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-4811fe8b-956d-4ad5-9e04-65bf6b87e893 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:29.135450 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-4811fe8b-956d-4ad5-9e04-65bf6b87e893 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:29.146481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-4811fe8b-956d-4ad5-9e04-65bf6b87e893 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1278 microversion: 2.1 time: 0.181328 May 18 17:20:29.155407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 567/1120] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:28 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:30.169705 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0ffd8ba5-948b-493f-9877-bc0dc53d897c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:30.170990 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0ffd8ba5-948b-493f-9877-bc0dc53d897c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:30.188051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0ffd8ba5-948b-493f-9877-bc0dc53d897c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:30.190641 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0ffd8ba5-948b-493f-9877-bc0dc53d897c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:30.191982 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0ffd8ba5-948b-493f-9877-bc0dc53d897c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:30.193065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0ffd8ba5-948b-493f-9877-bc0dc53d897c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:30.198049 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:30.762753 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0ffd8ba5-948b-493f-9877-bc0dc53d897c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:30.773758 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0ffd8ba5-948b-493f-9877-bc0dc53d897c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1318 microversion: 2.1 time: 0.612954 May 18 17:20:30.775209 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 554/1121] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:30 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1318 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:31.427238 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-128f333f-68b0-40df-83d3-3c8a23b4b846 req-109dfa25-2e5b-4a19-87f7-7c3a5c41cb35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56dbc5c0-e3d6-445c-9c79-819512f5c05b", "tag": "b066003c-138e-41ec-9790-91449076e778"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:31.443703 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-128f333f-68b0-40df-83d3-3c8a23b4b846 req-109dfa25-2e5b-4a19-87f7-7c3a5c41cb35 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:31.444148 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-128f333f-68b0-40df-83d3-3c8a23b4b846 req-109dfa25-2e5b-4a19-87f7-7c3a5c41cb35 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:31.458386 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-128f333f-68b0-40df-83d3-3c8a23b4b846 req-109dfa25-2e5b-4a19-87f7-7c3a5c41cb35 service nova] Creating event network-changed:b066003c-138e-41ec-9790-91449076e778 for instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b on hv-cinder-79578 May 18 17:20:31.464134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-128f333f-68b0-40df-83d3-3c8a23b4b846 req-109dfa25-2e5b-4a19-87f7-7c3a5c41cb35 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049693 May 18 17:20:31.465312 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 568/1122] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:20:31.795827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-3d231699-2c7e-45d2-83e2-3b4290e92476 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:31.796525 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-3d231699-2c7e-45d2-83e2-3b4290e92476 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:31.803854 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3d231699-2c7e-45d2-83e2-3b4290e92476 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:31.804649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3d231699-2c7e-45d2-83e2-3b4290e92476 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:31.805710 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3d231699-2c7e-45d2-83e2-3b4290e92476 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:31.806512 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-3d231699-2c7e-45d2-83e2-3b4290e92476 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:32.040933 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-3d231699-2c7e-45d2-83e2-3b4290e92476 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:32.054290 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-3d231699-2c7e-45d2-83e2-3b4290e92476 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1318 microversion: 2.1 time: 0.262223 May 18 17:20:32.055195 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 555/1123] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:31 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:33.076596 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ea459d19-79b1-4191-a864-bdb6a717bd0d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:33.077296 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ea459d19-79b1-4191-a864-bdb6a717bd0d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:33.085156 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ea459d19-79b1-4191-a864-bdb6a717bd0d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:33.085710 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ea459d19-79b1-4191-a864-bdb6a717bd0d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:33.086830 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ea459d19-79b1-4191-a864-bdb6a717bd0d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:33.087514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ea459d19-79b1-4191-a864-bdb6a717bd0d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:33.236284 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ea459d19-79b1-4191-a864-bdb6a717bd0d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:33.245387 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ea459d19-79b1-4191-a864-bdb6a717bd0d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1318 microversion: 2.1 time: 0.177073 May 18 17:20:33.245914 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 569/1124] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:33 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:34.267913 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-bf4e1fc0-bbd9-4eb9-b874-35bd8a3380e0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:34.268619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-bf4e1fc0-bbd9-4eb9-b874-35bd8a3380e0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:34.277324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bf4e1fc0-bbd9-4eb9-b874-35bd8a3380e0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:34.279015 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bf4e1fc0-bbd9-4eb9-b874-35bd8a3380e0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:34.280025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bf4e1fc0-bbd9-4eb9-b874-35bd8a3380e0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:34.280827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-bf4e1fc0-bbd9-4eb9-b874-35bd8a3380e0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:34.440727 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-bf4e1fc0-bbd9-4eb9-b874-35bd8a3380e0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:34.449239 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-bf4e1fc0-bbd9-4eb9-b874-35bd8a3380e0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1318 microversion: 2.1 time: 0.190263 May 18 17:20:34.449840 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 556/1125] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:34 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:35.467543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fd4c31e9-c394-44f7-bbc6-cc8c289695e9 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:35.469279 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fd4c31e9-c394-44f7-bbc6-cc8c289695e9 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:35.477396 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd4c31e9-c394-44f7-bbc6-cc8c289695e9 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:35.478257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd4c31e9-c394-44f7-bbc6-cc8c289695e9 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:35.479177 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd4c31e9-c394-44f7-bbc6-cc8c289695e9 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:35.480114 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fd4c31e9-c394-44f7-bbc6-cc8c289695e9 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:35.642632 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fd4c31e9-c394-44f7-bbc6-cc8c289695e9 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:35.650117 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fd4c31e9-c394-44f7-bbc6-cc8c289695e9 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1318 microversion: 2.1 time: 0.187152 May 18 17:20:35.650684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 570/1126] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:35 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:36.258518 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-b0020488-565a-4982-b148-9128bb5ed21a req-024b491b-1285-41f3-bbd7-dac3056d32c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56dbc5c0-e3d6-445c-9c79-819512f5c05b", "name": "network-vif-plugged", "status": "completed", "tag": "b066003c-138e-41ec-9790-91449076e778"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:20:36.262526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:36.270425 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b0020488-565a-4982-b148-9128bb5ed21a req-024b491b-1285-41f3-bbd7-dac3056d32c9 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:36.270929 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-b0020488-565a-4982-b148-9128bb5ed21a req-024b491b-1285-41f3-bbd7-dac3056d32c9 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:36.283987 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-b0020488-565a-4982-b148-9128bb5ed21a req-024b491b-1285-41f3-bbd7-dac3056d32c9 service nova] Creating event network-vif-plugged:b066003c-138e-41ec-9790-91449076e778 for instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b on hv-cinder-79578 May 18 17:20:36.289251 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-b0020488-565a-4982-b148-9128bb5ed21a req-024b491b-1285-41f3-bbd7-dac3056d32c9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034711 May 18 17:20:36.289994 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 557/1127] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:20:36.667765 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c9a8cb3a-d350-436f-a239-f6a9a362ed9a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:36.668376 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c9a8cb3a-d350-436f-a239-f6a9a362ed9a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:36.675422 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9a8cb3a-d350-436f-a239-f6a9a362ed9a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:36.675864 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9a8cb3a-d350-436f-a239-f6a9a362ed9a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:36.676618 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9a8cb3a-d350-436f-a239-f6a9a362ed9a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:36.677058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c9a8cb3a-d350-436f-a239-f6a9a362ed9a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:36.816460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c9a8cb3a-d350-436f-a239-f6a9a362ed9a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:36.824363 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c9a8cb3a-d350-436f-a239-f6a9a362ed9a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1318 microversion: 2.1 time: 0.160490 May 18 17:20:36.824924 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 571/1128] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:36 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:37.842726 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-d98ec8d2-f14e-47be-bb90-0ed623c75d7a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:37.843333 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-d98ec8d2-f14e-47be-bb90-0ed623c75d7a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:37.850389 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d2-f14e-47be-bb90-0ed623c75d7a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:37.850839 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d2-f14e-47be-bb90-0ed623c75d7a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:37.851614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d2-f14e-47be-bb90-0ed623c75d7a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:37.852050 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-d98ec8d2-f14e-47be-bb90-0ed623c75d7a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:37.951432 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:37.989218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-d98ec8d2-f14e-47be-bb90-0ed623c75d7a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:38.000202 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-d98ec8d2-f14e-47be-bb90-0ed623c75d7a tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1318 microversion: 2.1 time: 0.162326 May 18 17:20:38.000798 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 558/1129] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:37 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:20:39.018085 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-388a860a-38cb-472e-a70b-500844053bb0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:20:39.018704 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-388a860a-38cb-472e-a70b-500844053bb0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:20:39.021089 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:39.021799 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:20:39.027968 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-388a860a-38cb-472e-a70b-500844053bb0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:39.028423 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-388a860a-38cb-472e-a70b-500844053bb0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:39.029190 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-388a860a-38cb-472e-a70b-500844053bb0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:20:39.029633 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-388a860a-38cb-472e-a70b-500844053bb0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:20:39.162250 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-388a860a-38cb-472e-a70b-500844053bb0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:20:39.169879 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-388a860a-38cb-472e-a70b-500844053bb0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1506 microversion: 2.1 time: 0.155665 May 18 17:20:39.170447 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 572/1130] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:20:39 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:21:04.802602 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-606b345d-afc5-4862-853f-5a82bce0e7fc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a4256bf-213e-4b13-941d-ffe66c1ea67d", "device": "/dev/sdb"}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:21:04.804160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-606b345d-afc5-4862-853f-5a82bce0e7fc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:04.806128 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:04.806970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=25 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:04.813068 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-606b345d-afc5-4862-853f-5a82bce0e7fc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:04.813571 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-606b345d-afc5-4862-853f-5a82bce0e7fc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:04.814463 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-606b345d-afc5-4862-853f-5a82bce0e7fc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:04.814899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-606b345d-afc5-4862-853f-5a82bce0e7fc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:05.545947 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-606b345d-afc5-4862-853f-5a82bce0e7fc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "POST /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.747259 May 18 17:21:05.547328 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 559/1131] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:21:04 2022] POST /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b/os-volume_attachments => generated 194 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:21:35.563370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f52d4612-65ec-440c-99fd-5d6b86000892 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:35.563915 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f52d4612-65ec-440c-99fd-5d6b86000892 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:35.565991 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:35.566782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=77 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:35.572895 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f52d4612-65ec-440c-99fd-5d6b86000892 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:35.573346 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f52d4612-65ec-440c-99fd-5d6b86000892 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:35.574144 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f52d4612-65ec-440c-99fd-5d6b86000892 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:35.574577 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f52d4612-65ec-440c-99fd-5d6b86000892 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:35.857311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-f52d4612-65ec-440c-99fd-5d6b86000892 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lazy-loading 'services' on Instance uuid 56dbc5c0-e3d6-445c-9c79-819512f5c05b {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:21:35.931153 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f52d4612-65ec-440c-99fd-5d6b86000892 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "DELETE /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b/os-volume_attachments/5a4256bf-213e-4b13-941d-ffe66c1ea67d" status: 202 len: 0 microversion: 2.1 time: 0.372298 May 18 17:21:35.931750 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 573/1132] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:21:35 2022] DELETE /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b/os-volume_attachments/5a4256bf-213e-4b13-941d-ffe66c1ea67d => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:21:37.048846 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2702d2b5-1a28-4356-bdca-04d822c49596 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:37.049428 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2702d2b5-1a28-4356-bdca-04d822c49596 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:37.051967 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:37.052647 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:37.058937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2702d2b5-1a28-4356-bdca-04d822c49596 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:37.059398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2702d2b5-1a28-4356-bdca-04d822c49596 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:37.060188 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2702d2b5-1a28-4356-bdca-04d822c49596 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:37.060628 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-2702d2b5-1a28-4356-bdca-04d822c49596 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:37.088557 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2702d2b5-1a28-4356-bdca-04d822c49596 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Going to try to terminate instance {{(pid=117732) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:21:37.173081 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2702d2b5-1a28-4356-bdca-04d822c49596 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "DELETE /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 204 len: 0 microversion: 2.1 time: 0.128277 May 18 17:21:37.174206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 560/1133] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:21:37 2022] DELETE /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:21:37.187837 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-851c79a3-7224-4607-b7d6-daae796ba2bc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:37.189027 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-851c79a3-7224-4607-b7d6-daae796ba2bc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:37.197471 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-851c79a3-7224-4607-b7d6-daae796ba2bc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:37.198609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-851c79a3-7224-4607-b7d6-daae796ba2bc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:37.200020 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-851c79a3-7224-4607-b7d6-daae796ba2bc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:37.200815 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-851c79a3-7224-4607-b7d6-daae796ba2bc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:37.351157 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-851c79a3-7224-4607-b7d6-daae796ba2bc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:37.359295 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-851c79a3-7224-4607-b7d6-daae796ba2bc tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1512 microversion: 2.1 time: 0.178421 May 18 17:21:37.359870 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 574/1134] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:37 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:21:38.377642 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9f465837-bb26-458a-8c65-c155f1185d52 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:38.378296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9f465837-bb26-458a-8c65-c155f1185d52 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:38.385083 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f465837-bb26-458a-8c65-c155f1185d52 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:38.385535 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f465837-bb26-458a-8c65-c155f1185d52 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:38.386386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f465837-bb26-458a-8c65-c155f1185d52 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:38.386828 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9f465837-bb26-458a-8c65-c155f1185d52 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:38.528296 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9f465837-bb26-458a-8c65-c155f1185d52 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:38.536786 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9f465837-bb26-458a-8c65-c155f1185d52 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1512 microversion: 2.1 time: 0.164309 May 18 17:21:38.537333 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 561/1135] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:38 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:21:39.558064 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7fef57aa-1df1-4df3-bcb0-dd21ab5c7a28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:39.558664 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7fef57aa-1df1-4df3-bcb0-dd21ab5c7a28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:39.565839 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7fef57aa-1df1-4df3-bcb0-dd21ab5c7a28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:39.566299 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7fef57aa-1df1-4df3-bcb0-dd21ab5c7a28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:39.567167 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7fef57aa-1df1-4df3-bcb0-dd21ab5c7a28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:39.567595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7fef57aa-1df1-4df3-bcb0-dd21ab5c7a28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:39.574265 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-5e2824b8-248a-494d-823e-c09db5aee0b6 req-20e1826e-313d-44cd-9c65-713bff81982c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56dbc5c0-e3d6-445c-9c79-819512f5c05b", "name": "network-vif-deleted", "tag": "b066003c-138e-41ec-9790-91449076e778"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:21:39.586980 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-5e2824b8-248a-494d-823e-c09db5aee0b6 req-20e1826e-313d-44cd-9c65-713bff81982c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:39.587357 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-5e2824b8-248a-494d-823e-c09db5aee0b6 req-20e1826e-313d-44cd-9c65-713bff81982c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:39.600786 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-5e2824b8-248a-494d-823e-c09db5aee0b6 req-20e1826e-313d-44cd-9c65-713bff81982c service nova] Creating event network-vif-deleted:b066003c-138e-41ec-9790-91449076e778 for instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b on hv-cinder-79578 May 18 17:21:39.614970 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-5e2824b8-248a-494d-823e-c09db5aee0b6 req-20e1826e-313d-44cd-9c65-713bff81982c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044301 May 18 17:21:39.615618 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 562/1136] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:21:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:21:39.636892 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7fef57aa-1df1-4df3-bcb0-dd21ab5c7a28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:39.645175 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7fef57aa-1df1-4df3-bcb0-dd21ab5c7a28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 200 len: 1470 microversion: 2.1 time: 0.091061 May 18 17:21:39.646088 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 575/1137] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:39 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 1470 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:21:40.663426 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:40.664113 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 56dbc5c0-e3d6-445c-9c79-819512f5c05b] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:40.670294 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:40.670737 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:40.672219 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:40.672573 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:40.688347 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] HTTP exception thrown: Instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b could not be found. May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Request method failure captured: May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b HTTP/1.1 May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSrYVTJDqt1Elqg27FZ-Uyebknqo5XRVahkBTssycOAYvGJny1detg5l63oA59xTTDFwldLRVoxZlAMkNuddI-JulMEoufujhKbzik6Cpw0NZGz1TAMYDoRXALhHTf51o6DLZvPfjimluc5-U7n9aP7oFVqgvKch41TgH3-KbSs45EQ May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 746b5a83a469465cbd94f8f9dfa0db94 May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1286370722 May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:21:40.689981 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/746b5a83a469465cbd94f8f9dfa0db94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_746b5a83a469465cbd94f8f9dfa0db94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/746b5a83a469465cbd94f8f9dfa0db94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/746b5a83a469465cbd94f8f9dfa0db94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesSnapshotTestJSON-1286370722 May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 746b5a83a469465cbd94f8f9dfa0db94 May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1286370722 May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesSnapshotTestJSON-1286370722-project May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: f654d7139eea497591637bf43fc418f5 May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesSnapshotTestJSON-1286370722-project May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b could not be found. May 18 17:21:40.691767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '56dbc5c0-e3d6-445c-9c79-819512f5c05b'} May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b could not be found. May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:21:40.692662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b could not be found. May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b could not be found. May 18 17:21:40.694061 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:21:40.695262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Returning 404 to user: Instance 56dbc5c0-e3d6-445c-9c79-819512f5c05b could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:21:40.695262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-954e991d-d9b4-448d-9510-d45c7e90a063 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b" status: 404 len: 111 microversion: 2.1 time: 0.032607 May 18 17:21:40.695262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 563/1138] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:40 2022] GET /compute/v2.1/servers/56dbc5c0-e3d6-445c-9c79-819512f5c05b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:21:51.656158 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2029427990", "imageRef": "2c7465c8-69c4-4420-b844-08c8ab4ec2c5", "flavorRef": "452", "networks": [{"uuid": "b291bd50-0e61-424f-bfff-6e6d91c827e9"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:21:51.663520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:51.664181 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:51.718782 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] validate_networks() for [('b291bd50-0e61-424f-bfff-6e6d91c827e9', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:21:52.091623 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:21:52.092050 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:21:52.092530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:21:52.094130 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:21:52.094745 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:21:52.103836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:52.104285 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:52.105087 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:52.105524 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:52.123140 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Getting quotas for project 746b5a83a469465cbd94f8f9dfa0db94. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:21:52.127472 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Getting quotas for user f654d7139eea497591637bf43fc418f5 and project 746b5a83a469465cbd94f8f9dfa0db94. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:21:52.138595 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:21:52.140962 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2c7465c8-69c4-4420-b844-08c8ab4ec2c5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:21:52.188316 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-878487fa-64dd-47cd-a2a2-e9fb976046a2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536775 May 18 17:21:52.188957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 576/1139] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:21:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 539 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:21:52.205951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-2d04689a-666e-4d1e-9980-11863b847f3e tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:52.207076 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-2d04689a-666e-4d1e-9980-11863b847f3e tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:52.211386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:52.212478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:21:52.280791 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-2d04689a-666e-4d1e-9980-11863b847f3e tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:52.288215 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-2d04689a-666e-4d1e-9980-11863b847f3e tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1219 microversion: 2.1 time: 0.089391 May 18 17:21:52.288603 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 564/1140] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:52 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:21:53.306684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-46956e09-e871-4d9f-ac3b-339beef55823 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:53.307564 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-46956e09-e871-4d9f-ac3b-339beef55823 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:53.315520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46956e09-e871-4d9f-ac3b-339beef55823 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:53.315972 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46956e09-e871-4d9f-ac3b-339beef55823 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:53.316757 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46956e09-e871-4d9f-ac3b-339beef55823 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:53.317196 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46956e09-e871-4d9f-ac3b-339beef55823 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:53.417018 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-46956e09-e871-4d9f-ac3b-339beef55823 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:53.428774 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-46956e09-e871-4d9f-ac3b-339beef55823 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1279 microversion: 2.1 time: 0.125959 May 18 17:21:53.429480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 577/1141] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:53 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1279 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:21:54.452872 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-7b69f8e8-e080-4729-89ed-97467ab725fa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:54.454046 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-7b69f8e8-e080-4729-89ed-97467ab725fa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:54.468378 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b69f8e8-e080-4729-89ed-97467ab725fa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:54.469440 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b69f8e8-e080-4729-89ed-97467ab725fa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:54.471027 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b69f8e8-e080-4729-89ed-97467ab725fa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:54.471578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-7b69f8e8-e080-4729-89ed-97467ab725fa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:54.638451 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-7b69f8e8-e080-4729-89ed-97467ab725fa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:54.648159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-7b69f8e8-e080-4729-89ed-97467ab725fa tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1319 microversion: 2.1 time: 0.203709 May 18 17:21:54.648757 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 565/1142] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:54 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:21:54.994916 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-4acf8231-0190-43c7-a8a1-3dde7acf46b2 req-a050d436-9310-45a2-a7a1-334b5443afb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e700a73-1d67-4a6b-8a9f-0269c8a220e9", "tag": "fec221c0-faba-4c20-8303-d2a6aff83f8a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:21:55.015608 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-4acf8231-0190-43c7-a8a1-3dde7acf46b2 req-a050d436-9310-45a2-a7a1-334b5443afb0 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:55.016429 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-4acf8231-0190-43c7-a8a1-3dde7acf46b2 req-a050d436-9310-45a2-a7a1-334b5443afb0 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:55.031997 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-4acf8231-0190-43c7-a8a1-3dde7acf46b2 req-a050d436-9310-45a2-a7a1-334b5443afb0 service nova] Creating event network-changed:fec221c0-faba-4c20-8303-d2a6aff83f8a for instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 on hv-cinder-79578 May 18 17:21:55.038750 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-4acf8231-0190-43c7-a8a1-3dde7acf46b2 req-a050d436-9310-45a2-a7a1-334b5443afb0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053340 May 18 17:21:55.039850 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 578/1143] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:21:55.674415 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-ef799e8e-1703-47ba-aba5-682e77908591 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:55.675073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-ef799e8e-1703-47ba-aba5-682e77908591 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:55.682132 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef799e8e-1703-47ba-aba5-682e77908591 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:55.682583 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef799e8e-1703-47ba-aba5-682e77908591 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:55.683393 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef799e8e-1703-47ba-aba5-682e77908591 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:55.683834 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-ef799e8e-1703-47ba-aba5-682e77908591 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:55.829799 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-ef799e8e-1703-47ba-aba5-682e77908591 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:55.838073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-ef799e8e-1703-47ba-aba5-682e77908591 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1319 microversion: 2.1 time: 0.168769 May 18 17:21:55.838835 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 566/1144] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:55 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:21:56.860432 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-5948afbd-7646-41d2-ac1f-f9574f6d8bfb tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:56.861135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-5948afbd-7646-41d2-ac1f-f9574f6d8bfb tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:56.869021 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5948afbd-7646-41d2-ac1f-f9574f6d8bfb tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:56.869483 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5948afbd-7646-41d2-ac1f-f9574f6d8bfb tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:56.870276 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5948afbd-7646-41d2-ac1f-f9574f6d8bfb tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:56.871081 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-5948afbd-7646-41d2-ac1f-f9574f6d8bfb tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:57.027929 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-5948afbd-7646-41d2-ac1f-f9574f6d8bfb tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:57.037499 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-5948afbd-7646-41d2-ac1f-f9574f6d8bfb tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1319 microversion: 2.1 time: 0.183752 May 18 17:21:57.038118 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 579/1145] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:56 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:21:58.054541 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-53f78266-c4a9-4158-aabc-83a598e729df tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:58.055191 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-53f78266-c4a9-4158-aabc-83a598e729df tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:58.063189 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-53f78266-c4a9-4158-aabc-83a598e729df tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:58.063640 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-53f78266-c4a9-4158-aabc-83a598e729df tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:58.064621 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-53f78266-c4a9-4158-aabc-83a598e729df tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:58.065064 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-53f78266-c4a9-4158-aabc-83a598e729df tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:58.225849 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-53f78266-c4a9-4158-aabc-83a598e729df tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:58.234085 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-53f78266-c4a9-4158-aabc-83a598e729df tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1319 microversion: 2.1 time: 0.183387 May 18 17:21:58.237885 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 567/1146] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:58 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:21:59.250867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-7a2702d9-90eb-466f-8cd3-c9a93969a7d2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:21:59.251541 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-7a2702d9-90eb-466f-8cd3-c9a93969a7d2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:21:59.257985 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a2702d9-90eb-466f-8cd3-c9a93969a7d2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:59.258439 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a2702d9-90eb-466f-8cd3-c9a93969a7d2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:59.259273 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a2702d9-90eb-466f-8cd3-c9a93969a7d2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:21:59.259740 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-7a2702d9-90eb-466f-8cd3-c9a93969a7d2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:21:59.411800 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-7a2702d9-90eb-466f-8cd3-c9a93969a7d2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:21:59.419407 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-7a2702d9-90eb-466f-8cd3-c9a93969a7d2 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1319 microversion: 2.1 time: 0.173137 May 18 17:21:59.419984 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 580/1147] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:21:59 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:22:00.438357 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-85637ef1-f100-48bd-ba25-683f2f061cbe tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:00.439074 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-85637ef1-f100-48bd-ba25-683f2f061cbe tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:00.446366 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85637ef1-f100-48bd-ba25-683f2f061cbe tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:00.446825 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85637ef1-f100-48bd-ba25-683f2f061cbe tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:00.447844 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85637ef1-f100-48bd-ba25-683f2f061cbe tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:00.448270 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-85637ef1-f100-48bd-ba25-683f2f061cbe tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:00.598111 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-85637ef1-f100-48bd-ba25-683f2f061cbe tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:22:00.605820 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-85637ef1-f100-48bd-ba25-683f2f061cbe tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1319 microversion: 2.1 time: 0.172031 May 18 17:22:00.606407 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 568/1148] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:22:00 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:22:00.850267 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-a03826eb-673a-4d09-9e9f-152f3323f07b req-d6edb958-8bea-4ceb-9b5a-a0d94c99754f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e700a73-1d67-4a6b-8a9f-0269c8a220e9", "name": "network-vif-plugged", "status": "completed", "tag": "fec221c0-faba-4c20-8303-d2a6aff83f8a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:22:00.866248 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a03826eb-673a-4d09-9e9f-152f3323f07b req-d6edb958-8bea-4ceb-9b5a-a0d94c99754f service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:00.866821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-a03826eb-673a-4d09-9e9f-152f3323f07b req-d6edb958-8bea-4ceb-9b5a-a0d94c99754f service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:00.882455 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-a03826eb-673a-4d09-9e9f-152f3323f07b req-d6edb958-8bea-4ceb-9b5a-a0d94c99754f service nova] Creating event network-vif-plugged:fec221c0-faba-4c20-8303-d2a6aff83f8a for instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 on hv-cinder-79578 May 18 17:22:00.887990 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-a03826eb-673a-4d09-9e9f-152f3323f07b req-d6edb958-8bea-4ceb-9b5a-a0d94c99754f service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045726 May 18 17:22:00.888677 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 581/1149] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:22:01.623585 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-677e65d2-d8f0-4f16-b35e-ee776d10bb39 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:01.624396 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-677e65d2-d8f0-4f16-b35e-ee776d10bb39 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:01.631222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-677e65d2-d8f0-4f16-b35e-ee776d10bb39 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:01.631665 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-677e65d2-d8f0-4f16-b35e-ee776d10bb39 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:01.632467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-677e65d2-d8f0-4f16-b35e-ee776d10bb39 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:01.632899 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-677e65d2-d8f0-4f16-b35e-ee776d10bb39 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:01.774370 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-677e65d2-d8f0-4f16-b35e-ee776d10bb39 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:22:01.784982 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-677e65d2-d8f0-4f16-b35e-ee776d10bb39 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1319 microversion: 2.1 time: 0.165599 May 18 17:22:01.790254 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 569/1150] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:22:01 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:22:02.800964 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:02.801789 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:02.806981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-011d634b-d765-4f2a-be56-5175b5b1ed08 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:02.807390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-011d634b-d765-4f2a-be56-5175b5b1ed08 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:02.816699 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-011d634b-d765-4f2a-be56-5175b5b1ed08 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:02.817152 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-011d634b-d765-4f2a-be56-5175b5b1ed08 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:02.817973 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-011d634b-d765-4f2a-be56-5175b5b1ed08 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:02.818419 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-011d634b-d765-4f2a-be56-5175b5b1ed08 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:02.971132 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-011d634b-d765-4f2a-be56-5175b5b1ed08 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:22:02.984865 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-011d634b-d765-4f2a-be56-5175b5b1ed08 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1319 microversion: 2.1 time: 0.185207 May 18 17:22:02.985923 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 582/1151] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:22:02 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:22:04.010500 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-92d7f341-ecac-429e-a207-89e19cc4e76c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:04.011371 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-92d7f341-ecac-429e-a207-89e19cc4e76c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:04.013153 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:04.020614 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92d7f341-ecac-429e-a207-89e19cc4e76c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:04.021068 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92d7f341-ecac-429e-a207-89e19cc4e76c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:04.022262 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92d7f341-ecac-429e-a207-89e19cc4e76c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:04.022764 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-92d7f341-ecac-429e-a207-89e19cc4e76c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:04.174081 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-92d7f341-ecac-429e-a207-89e19cc4e76c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:22:04.181848 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-92d7f341-ecac-429e-a207-89e19cc4e76c tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1507 microversion: 2.1 time: 0.175241 May 18 17:22:04.182505 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 570/1152] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:22:04 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:22:04.198555 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-6b5359c9-25b6-49d5-8325-9b57816d208d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38b6170b-a9dd-497f-b984-8564bb259e56", "device": "/dev/sdb"}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:22:04.200173 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-6b5359c9-25b6-49d5-8325-9b57816d208d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:04.207967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6b5359c9-25b6-49d5-8325-9b57816d208d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:04.208514 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6b5359c9-25b6-49d5-8325-9b57816d208d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:04.209322 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6b5359c9-25b6-49d5-8325-9b57816d208d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:04.209805 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-6b5359c9-25b6-49d5-8325-9b57816d208d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:04.488903 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-6b5359c9-25b6-49d5-8325-9b57816d208d tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "POST /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294293 May 18 17:22:04.489521 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 583/1153] 10.222.0.49 () {60 vars in 1322 bytes} [Wed May 18 17:22:04 2022] POST /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:22:27.000253 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-54078526-c89d-4355-bff9-a7647d3269b5 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:27.000730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-54078526-c89d-4355-bff9-a7647d3269b5 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:27.002775 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=16 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:27.003474 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=36 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:27.009615 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-54078526-c89d-4355-bff9-a7647d3269b5 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:27.010099 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-54078526-c89d-4355-bff9-a7647d3269b5 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:27.010867 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-54078526-c89d-4355-bff9-a7647d3269b5 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:27.011300 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-54078526-c89d-4355-bff9-a7647d3269b5 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:27.098965 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-54078526-c89d-4355-bff9-a7647d3269b5 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lazy-loading 'services' on Instance uuid 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:22:27.172567 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-54078526-c89d-4355-bff9-a7647d3269b5 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9/os-volume_attachments/38b6170b-a9dd-497f-b984-8564bb259e56" status: 202 len: 0 microversion: 2.1 time: 0.176300 May 18 17:22:27.173233 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 571/1154] 10.222.0.49 () {58 vars in 1415 bytes} [Wed May 18 17:22:26 2022] DELETE /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9/os-volume_attachments/38b6170b-a9dd-497f-b984-8564bb259e56 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:22:28.287859 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:28.288631 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:22:28.293058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-2602c1a7-d254-4853-9805-b3e3a29f4c8f tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:28.293647 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2602c1a7-d254-4853-9805-b3e3a29f4c8f tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:28.302581 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2602c1a7-d254-4853-9805-b3e3a29f4c8f tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:28.303036 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2602c1a7-d254-4853-9805-b3e3a29f4c8f tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:28.303820 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2602c1a7-d254-4853-9805-b3e3a29f4c8f tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:28.304263 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-2602c1a7-d254-4853-9805-b3e3a29f4c8f tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:28.334440 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-2602c1a7-d254-4853-9805-b3e3a29f4c8f tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:22:28.412404 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-2602c1a7-d254-4853-9805-b3e3a29f4c8f tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "DELETE /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 204 len: 0 microversion: 2.1 time: 0.126848 May 18 17:22:28.413011 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 584/1155] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:22:28 2022] DELETE /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:22:28.422686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-1f2446ac-5718-40ce-84be-55a6cc6a6507 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:28.423388 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-1f2446ac-5718-40ce-84be-55a6cc6a6507 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:28.429783 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f2446ac-5718-40ce-84be-55a6cc6a6507 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:28.430235 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f2446ac-5718-40ce-84be-55a6cc6a6507 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:28.431026 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f2446ac-5718-40ce-84be-55a6cc6a6507 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:28.431459 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-1f2446ac-5718-40ce-84be-55a6cc6a6507 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:28.563078 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-1f2446ac-5718-40ce-84be-55a6cc6a6507 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:22:28.570507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-1f2446ac-5718-40ce-84be-55a6cc6a6507 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1513 microversion: 2.1 time: 0.152569 May 18 17:22:28.571072 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 572/1156] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:22:28 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:22:29.588788 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ef2a228e-7e86-4e05-a972-f882b9597209 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:29.589575 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ef2a228e-7e86-4e05-a972-f882b9597209 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:29.596680 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ef2a228e-7e86-4e05-a972-f882b9597209 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:29.597124 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ef2a228e-7e86-4e05-a972-f882b9597209 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:29.598561 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ef2a228e-7e86-4e05-a972-f882b9597209 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:29.599003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ef2a228e-7e86-4e05-a972-f882b9597209 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:29.742636 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ef2a228e-7e86-4e05-a972-f882b9597209 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:22:29.750803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ef2a228e-7e86-4e05-a972-f882b9597209 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1513 microversion: 2.1 time: 0.166460 May 18 17:22:29.751401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 585/1157] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:22:29 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:22:30.768353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-49659c86-8d2a-4eab-9ee5-3c48033fcd28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:30.769083 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-49659c86-8d2a-4eab-9ee5-3c48033fcd28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:30.776409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49659c86-8d2a-4eab-9ee5-3c48033fcd28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:30.776866 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49659c86-8d2a-4eab-9ee5-3c48033fcd28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:30.777674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49659c86-8d2a-4eab-9ee5-3c48033fcd28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:30.778121 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49659c86-8d2a-4eab-9ee5-3c48033fcd28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:30.929007 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-49659c86-8d2a-4eab-9ee5-3c48033fcd28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f654d7139eea497591637bf43fc418f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '746b5a83a469465cbd94f8f9dfa0db94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:22:30.944278 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-49659c86-8d2a-4eab-9ee5-3c48033fcd28 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 200 len: 1513 microversion: 2.1 time: 0.179627 May 18 17:22:30.944864 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 573/1158] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:22:30 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:22:31.061808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-f170b0f4-5850-44e0-acdf-9fb874368b2b req-fd9d0c31-9b42-4367-b2d6-f75876101757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e700a73-1d67-4a6b-8a9f-0269c8a220e9", "name": "network-vif-deleted", "tag": "fec221c0-faba-4c20-8303-d2a6aff83f8a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:22:31.072232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f170b0f4-5850-44e0-acdf-9fb874368b2b req-fd9d0c31-9b42-4367-b2d6-f75876101757 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:31.072684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-f170b0f4-5850-44e0-acdf-9fb874368b2b req-fd9d0c31-9b42-4367-b2d6-f75876101757 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:31.085895 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-f170b0f4-5850-44e0-acdf-9fb874368b2b req-fd9d0c31-9b42-4367-b2d6-f75876101757 service nova] Creating event network-vif-deleted:fec221c0-faba-4c20-8303-d2a6aff83f8a for instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 on hv-cinder-79578 May 18 17:22:31.091425 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-f170b0f4-5850-44e0-acdf-9fb874368b2b req-fd9d0c31-9b42-4367-b2d6-f75876101757 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033427 May 18 17:22:31.092257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 586/1159] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:22:31.967177 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:22:31.967805 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] [instance: 2e700a73-1d67-4a6b-8a9f-0269c8a220e9] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:22:31.975281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:31.975734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:31.976514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:22:31.976953 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:22:31.991605 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] HTTP exception thrown: Instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 could not be found. May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Request method failure captured: May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 HTTP/1.1 May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSrYVTJDqt1Elqg27FZ-Uyebknqo5XRVahkBTssycOAYvGJny1detg5l63oA59xTTDFwldLRVoxZlAMkNuddI-JulMEoufujhKbzik6Cpw0NZGz1TAMYDoRXALhHTf51o6DLZvPfjimluc5-U7n9aP7oFVqgvKch41TgH3-KbSs45EQ May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 746b5a83a469465cbd94f8f9dfa0db94 May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1286370722 May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:22:31.993281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/746b5a83a469465cbd94f8f9dfa0db94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_746b5a83a469465cbd94f8f9dfa0db94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/746b5a83a469465cbd94f8f9dfa0db94"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/746b5a83a469465cbd94f8f9dfa0db94"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-VolumesSnapshotTestJSON-1286370722 May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 746b5a83a469465cbd94f8f9dfa0db94 May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1286370722 May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-VolumesSnapshotTestJSON-1286370722-project May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: f654d7139eea497591637bf43fc418f5 May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-VolumesSnapshotTestJSON-1286370722-project May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 could not be found. May 18 17:22:31.995003 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '2e700a73-1d67-4a6b-8a9f-0269c8a220e9'} May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 could not be found. May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:22:31.996200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 could not be found. May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 could not be found. May 18 17:22:31.997829 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:22:31.999229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] Returning 404 to user: Instance 2e700a73-1d67-4a6b-8a9f-0269c8a220e9 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:22:31.999229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9d40c71b-8e4a-41b5-9bd0-947396bce7c0 tempest-VolumesSnapshotTestJSON-1286370722 tempest-VolumesSnapshotTestJSON-1286370722-project] 10.222.0.49 "GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9" status: 404 len: 111 microversion: 2.1 time: 0.031773 May 18 17:22:31.999229 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 574/1160] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:22:31 2022] GET /compute/v2.1/servers/2e700a73-1d67-4a6b-8a9f-0269c8a220e9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:22:53.012864 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:22:53.013717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:22:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:23:26.330677 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:26.331568 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:26.337645 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-d94aad93-8a70-494e-91be-b916495a3a3f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:26.338270 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d94aad93-8a70-494e-91be-b916495a3a3f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:26.346727 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d94aad93-8a70-494e-91be-b916495a3a3f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:26.347232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d94aad93-8a70-494e-91be-b916495a3a3f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:26.348031 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d94aad93-8a70-494e-91be-b916495a3a3f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:26.348481 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-d94aad93-8a70-494e-91be-b916495a3a3f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:26.383066 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-d94aad93-8a70-494e-91be-b916495a3a3f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:23:26.470849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-d94aad93-8a70-494e-91be-b916495a3a3f tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 204 len: 0 microversion: 2.1 time: 0.141580 May 18 17:23:26.471460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 587/1161] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:23:26 2022] DELETE /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:23:26.483028 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-83bbeb78-c13b-42fe-9fa6-ef0d3528cb15 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:26.483695 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-83bbeb78-c13b-42fe-9fa6-ef0d3528cb15 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:26.486734 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=8 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:26.487814 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:26.496871 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-83bbeb78-c13b-42fe-9fa6-ef0d3528cb15 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:26.497324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-83bbeb78-c13b-42fe-9fa6-ef0d3528cb15 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:26.498139 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-83bbeb78-c13b-42fe-9fa6-ef0d3528cb15 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:26.498578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-83bbeb78-c13b-42fe-9fa6-ef0d3528cb15 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:26.647905 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-83bbeb78-c13b-42fe-9fa6-ef0d3528cb15 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:26.656002 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-83bbeb78-c13b-42fe-9fa6-ef0d3528cb15 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1577 microversion: 2.1 time: 0.179359 May 18 17:23:26.656589 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 575/1162] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:26 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:27.675211 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-47898199-bc9d-43b9-93ec-b6ee66335227 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:27.675966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-47898199-bc9d-43b9-93ec-b6ee66335227 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:27.684174 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47898199-bc9d-43b9-93ec-b6ee66335227 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:27.684640 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47898199-bc9d-43b9-93ec-b6ee66335227 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:27.685534 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47898199-bc9d-43b9-93ec-b6ee66335227 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:27.686025 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-47898199-bc9d-43b9-93ec-b6ee66335227 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:27.860660 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-47898199-bc9d-43b9-93ec-b6ee66335227 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:27.869998 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-47898199-bc9d-43b9-93ec-b6ee66335227 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1577 microversion: 2.1 time: 0.199354 May 18 17:23:27.870592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 588/1163] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:27 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:28.891317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-02b24741-3047-470b-a0f0-441c87f58473 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:28.892357 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-02b24741-3047-470b-a0f0-441c87f58473 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:28.904454 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-02b24741-3047-470b-a0f0-441c87f58473 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:28.905281 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-02b24741-3047-470b-a0f0-441c87f58473 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:28.906754 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-02b24741-3047-470b-a0f0-441c87f58473 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:28.907530 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-02b24741-3047-470b-a0f0-441c87f58473 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:29.002577 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-02b24741-3047-470b-a0f0-441c87f58473 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:29.017591 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-02b24741-3047-470b-a0f0-441c87f58473 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1510 microversion: 2.1 time: 0.132515 May 18 17:23:29.018831 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 576/1164] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:28 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1510 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:29.302059 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-95fe554d-4c82-4912-9f08-69047e651d69 req-631a103f-c506-4b6f-a068-0e0919ad28d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b6ed6b2-128c-48f2-a895-5729c9e0eda2", "name": "network-vif-deleted", "tag": "811b811b-67d8-4153-9fae-a77d7dfb624f"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:23:29.311749 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-95fe554d-4c82-4912-9f08-69047e651d69 req-631a103f-c506-4b6f-a068-0e0919ad28d5 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:29.312463 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-95fe554d-4c82-4912-9f08-69047e651d69 req-631a103f-c506-4b6f-a068-0e0919ad28d5 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:29.334604 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-95fe554d-4c82-4912-9f08-69047e651d69 req-631a103f-c506-4b6f-a068-0e0919ad28d5 service nova] Creating event network-vif-deleted:811b811b-67d8-4153-9fae-a77d7dfb624f for instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 on hv-cinder-79578 May 18 17:23:29.345104 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-95fe554d-4c82-4912-9f08-69047e651d69 req-631a103f-c506-4b6f-a068-0e0919ad28d5 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046702 May 18 17:23:29.349526 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 589/1165] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:23:30.036900 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:30.038564 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:30.045580 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:30.046041 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:30.046869 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:30.047309 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:30.106318 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:30.107137 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:30.107956 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.objects.instance [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lazy-loading 'fault' on Instance uuid 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 {{(pid=117732) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:23:30.167778 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:30.176159 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b9198c9d-0a40-41e9-a981-2bf8f61d69f6 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 200 len: 1231 microversion: 2.1 time: 0.143589 May 18 17:23:30.177730 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 577/1166] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:30 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 1231 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:23:31.202462 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:31.203792 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:31.216919 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:31.217814 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:31.219249 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:31.220328 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:31.249559 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] HTTP exception thrown: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Request method failure captured: May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 HTTP/1.1 May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSqQuoS42h5t48R6K_qlsI6oAAuRe9P_v3yP4mW54RSS0Jsh5_RrmAzkW6IHBzFXDGipiHOPgTwb5WtbbubfOBhew9w5Kiw3kpm4k7m6AVzPxvb7mKTWKTqTCw3m8GK5luIMucRYaYxr94Qllj51Ipb_W4eagGq5UmTNq9t0nY9LU_I May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:23:31.252957 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-TestVolumeBootPattern-685432326 May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-TestVolumeBootPattern-685432326-project May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 53394412ea1f463196acd85c7e11621c May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-TestVolumeBootPattern-685432326-project May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:23:31.254851 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '6b6ed6b2-128c-48f2-a895-5729c9e0eda2'} May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:23:31.256501 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:23:31.258401 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:23:31.259867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Returning 404 to user: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:23:31.259867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-597cd520-25f2-4c1c-8988-276aa4bd5b19 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 404 len: 111 microversion: 2.1 time: 0.063197 May 18 17:23:31.259867 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 590/1167] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:31 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:23:31.398306 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1465231208", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1878139194", "security_groups": [{"name": "tempest-secgroup-smoke-178296769"}], "block_device_mapping_v2": [{"uuid": "e7743ed0-eaf0-44aa-9d0c-6d8f727e68fe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3758902-7248-457c-ac74-050337304611"}]}} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:23:31.545211 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.network.neutron [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] validate_networks() for [('d3758902-7248-457c-ac74-050337304611', None, None, None, None, None)] {{(pid=117732) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:23:32.255369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Flavor limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:23:32.256915 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Image limits 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:23:32.257386 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Flavor pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:23:32.257848 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Image pref 0:0:0 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:23:32.258258 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.virt.hardware [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117732) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:23:32.267461 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:32.267897 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:32.268684 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:32.269114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:32.290846 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Getting quotas for project 467c9f16c74546a68e59acbff2542cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:23:32.295136 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.quota [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Getting quotas for user 53394412ea1f463196acd85c7e11621c and project 467c9f16c74546a68e59acbff2542cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=117732) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:23:32.358272 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Going to run 1 instances... {{(pid=117732) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:23:32.360558 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7743ed0-eaf0-44aa-9d0c-6d8f727e68fe',volume_size=None,volume_type=None)] {{(pid=117732) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:23:32.504134 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b073acd0-fe5c-4c9e-8092-fad6e5e344cb tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.110890 May 18 17:23:32.504785 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 578/1168] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:23:31 2022] POST /compute/v2.1/servers => generated 405 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 18 17:23:32.515068 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-8944f4ae-3e45-4227-9c0d-9b23fda450f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:32.515808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-8944f4ae-3e45-4227-9c0d-9b23fda450f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:32.577197 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-8944f4ae-3e45-4227-9c0d-9b23fda450f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:32.585869 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-8944f4ae-3e45-4227-9c0d-9b23fda450f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1095 microversion: 2.1 time: 0.074661 May 18 17:23:32.586461 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 591/1169] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:32 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:23:33.604849 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0970c88f-c50f-4512-90ed-e0d2293cc6b7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:33.606392 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0970c88f-c50f-4512-90ed-e0d2293cc6b7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:33.615402 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0970c88f-c50f-4512-90ed-e0d2293cc6b7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:33.616237 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0970c88f-c50f-4512-90ed-e0d2293cc6b7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:33.617256 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0970c88f-c50f-4512-90ed-e0d2293cc6b7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:33.617937 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0970c88f-c50f-4512-90ed-e0d2293cc6b7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:33.700480 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0970c88f-c50f-4512-90ed-e0d2293cc6b7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:33.709166 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0970c88f-c50f-4512-90ed-e0d2293cc6b7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1201 microversion: 2.1 time: 0.108567 May 18 17:23:33.710046 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 579/1170] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:33 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1201 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:34.728941 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-87953f49-b213-4b09-8e1b-e79ae646f438 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:34.730022 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-87953f49-b213-4b09-8e1b-e79ae646f438 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:34.744596 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87953f49-b213-4b09-8e1b-e79ae646f438 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:34.745061 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87953f49-b213-4b09-8e1b-e79ae646f438 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:34.745894 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87953f49-b213-4b09-8e1b-e79ae646f438 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:34.746342 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-87953f49-b213-4b09-8e1b-e79ae646f438 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:34.970609 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-87953f49-b213-4b09-8e1b-e79ae646f438 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:34.980424 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-87953f49-b213-4b09-8e1b-e79ae646f438 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.256832 May 18 17:23:34.981260 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 592/1171] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:34 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:35.376181 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-3e4570cb-be36-48b1-be73-ffb96095d4be req-1f4ca807-3113-4d7d-900e-eb19710a4e16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e", "tag": "cf42a5ae-99d2-470f-8f28-a354170dd6a4"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:23:35.397312 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-3e4570cb-be36-48b1-be73-ffb96095d4be req-1f4ca807-3113-4d7d-900e-eb19710a4e16 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:35.398147 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-3e4570cb-be36-48b1-be73-ffb96095d4be req-1f4ca807-3113-4d7d-900e-eb19710a4e16 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:35.421591 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-3e4570cb-be36-48b1-be73-ffb96095d4be req-1f4ca807-3113-4d7d-900e-eb19710a4e16 service nova] Creating event network-changed:cf42a5ae-99d2-470f-8f28-a354170dd6a4 for instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e on hv-cinder-79578 May 18 17:23:35.427888 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-3e4570cb-be36-48b1-be73-ffb96095d4be req-1f4ca807-3113-4d7d-900e-eb19710a4e16 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058849 May 18 17:23:35.429023 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 580/1172] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:23:35.999791 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-005dbe8a-b1fa-46cc-b57c-0b336c60a64b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:36.000554 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-005dbe8a-b1fa-46cc-b57c-0b336c60a64b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:36.007888 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-005dbe8a-b1fa-46cc-b57c-0b336c60a64b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:36.008348 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-005dbe8a-b1fa-46cc-b57c-0b336c60a64b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:36.009134 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-005dbe8a-b1fa-46cc-b57c-0b336c60a64b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:36.009578 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-005dbe8a-b1fa-46cc-b57c-0b336c60a64b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:36.160894 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-005dbe8a-b1fa-46cc-b57c-0b336c60a64b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:36.172415 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-005dbe8a-b1fa-46cc-b57c-0b336c60a64b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.176486 May 18 17:23:36.173006 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 593/1173] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:35 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:23:37.191213 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-93ed97e9-b374-4c6d-9c11-dc2d456e9d23 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:37.192249 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-93ed97e9-b374-4c6d-9c11-dc2d456e9d23 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:37.199652 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-93ed97e9-b374-4c6d-9c11-dc2d456e9d23 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:37.200150 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-93ed97e9-b374-4c6d-9c11-dc2d456e9d23 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:37.200951 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-93ed97e9-b374-4c6d-9c11-dc2d456e9d23 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:37.201544 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-93ed97e9-b374-4c6d-9c11-dc2d456e9d23 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:37.371162 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-93ed97e9-b374-4c6d-9c11-dc2d456e9d23 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:37.379533 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-93ed97e9-b374-4c6d-9c11-dc2d456e9d23 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.192766 May 18 17:23:37.380703 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 581/1174] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:37 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 18 17:23:38.398936 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-fdacd932-f7ed-4375-b7bb-9e5dbb9ec441 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:38.399507 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-fdacd932-f7ed-4375-b7bb-9e5dbb9ec441 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:38.406454 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fdacd932-f7ed-4375-b7bb-9e5dbb9ec441 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:38.406905 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fdacd932-f7ed-4375-b7bb-9e5dbb9ec441 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:38.407692 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fdacd932-f7ed-4375-b7bb-9e5dbb9ec441 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:38.408135 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-fdacd932-f7ed-4375-b7bb-9e5dbb9ec441 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:38.549523 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-fdacd932-f7ed-4375-b7bb-9e5dbb9ec441 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:38.558451 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-fdacd932-f7ed-4375-b7bb-9e5dbb9ec441 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.164028 May 18 17:23:38.559052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 594/1175] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:38 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:39.575974 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f30feead-ab60-45f7-baca-9988363dc1f7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:39.576611 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f30feead-ab60-45f7-baca-9988363dc1f7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:39.583475 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f30feead-ab60-45f7-baca-9988363dc1f7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:39.584126 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f30feead-ab60-45f7-baca-9988363dc1f7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:39.584674 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f30feead-ab60-45f7-baca-9988363dc1f7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:39.585135 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f30feead-ab60-45f7-baca-9988363dc1f7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:39.602490 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:23:39.602894 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:23:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e (ip 10.222.0.49) !!! May 18 17:23:39.753752 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-f30feead-ab60-45f7-baca-9988363dc1f7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:39.763051 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f30feead-ab60-45f7-baca-9988363dc1f7 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.190808 May 18 17:23:39.763701 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 582/1176] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:39 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:40.783355 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-e0912436-c4ef-4b78-be3e-a63ed1b09972 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:40.783981 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-e0912436-c4ef-4b78-be3e-a63ed1b09972 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:40.791821 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0912436-c4ef-4b78-be3e-a63ed1b09972 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:40.792304 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0912436-c4ef-4b78-be3e-a63ed1b09972 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:40.793335 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0912436-c4ef-4b78-be3e-a63ed1b09972 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:40.794093 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-e0912436-c4ef-4b78-be3e-a63ed1b09972 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:40.960069 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-e0912436-c4ef-4b78-be3e-a63ed1b09972 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:40.967988 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-e0912436-c4ef-4b78-be3e-a63ed1b09972 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.189444 May 18 17:23:40.968574 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 595/1177] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:40 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:41.985301 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fec2b31f-0b84-4c31-9c17-9444f2eb03f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:41.985961 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fec2b31f-0b84-4c31-9c17-9444f2eb03f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:41.992777 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fec2b31f-0b84-4c31-9c17-9444f2eb03f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:41.993220 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fec2b31f-0b84-4c31-9c17-9444f2eb03f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:41.994022 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fec2b31f-0b84-4c31-9c17-9444f2eb03f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:41.994461 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fec2b31f-0b84-4c31-9c17-9444f2eb03f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:42.133982 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fec2b31f-0b84-4c31-9c17-9444f2eb03f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:42.141578 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fec2b31f-0b84-4c31-9c17-9444f2eb03f1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.160172 May 18 17:23:42.142200 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 583/1178] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:41 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:43.159361 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-54ad2e16-73ca-44d0-8606-5e7e260bfd5d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:43.159963 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-54ad2e16-73ca-44d0-8606-5e7e260bfd5d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:43.163343 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:43.169417 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54ad2e16-73ca-44d0-8606-5e7e260bfd5d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:43.169912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54ad2e16-73ca-44d0-8606-5e7e260bfd5d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:43.170982 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54ad2e16-73ca-44d0-8606-5e7e260bfd5d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:43.171428 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-54ad2e16-73ca-44d0-8606-5e7e260bfd5d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:43.323858 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-54ad2e16-73ca-44d0-8606-5e7e260bfd5d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:43.331619 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-54ad2e16-73ca-44d0-8606-5e7e260bfd5d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.176136 May 18 17:23:43.332203 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 596/1179] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:43 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:44.354918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-0dd5b3dd-71f3-4c8d-8d25-aac55204bb29 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:44.355782 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-0dd5b3dd-71f3-4c8d-8d25-aac55204bb29 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:44.358771 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:44.360218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=6 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:23:44.373362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0dd5b3dd-71f3-4c8d-8d25-aac55204bb29 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:44.373362 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0dd5b3dd-71f3-4c8d-8d25-aac55204bb29 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:44.374868 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0dd5b3dd-71f3-4c8d-8d25-aac55204bb29 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:44.375478 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-0dd5b3dd-71f3-4c8d-8d25-aac55204bb29 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:44.543186 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-0dd5b3dd-71f3-4c8d-8d25-aac55204bb29 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:44.552482 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-0dd5b3dd-71f3-4c8d-8d25-aac55204bb29 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.202827 May 18 17:23:44.553089 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 584/1180] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:44 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:45.576834 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ed56c7ef-2771-4d2d-805f-2e6c107bc80a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:45.577437 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ed56c7ef-2771-4d2d-805f-2e6c107bc80a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:45.586453 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed56c7ef-2771-4d2d-805f-2e6c107bc80a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:45.587200 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed56c7ef-2771-4d2d-805f-2e6c107bc80a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:45.588303 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed56c7ef-2771-4d2d-805f-2e6c107bc80a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:45.588967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ed56c7ef-2771-4d2d-805f-2e6c107bc80a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:45.737311 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ed56c7ef-2771-4d2d-805f-2e6c107bc80a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:45.745803 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ed56c7ef-2771-4d2d-805f-2e6c107bc80a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.172728 May 18 17:23:45.746430 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 597/1181] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:45 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:46.763507 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5322b513-c1e9-484f-abbb-86133289731c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:46.764142 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5322b513-c1e9-484f-abbb-86133289731c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:46.771449 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5322b513-c1e9-484f-abbb-86133289731c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:46.771892 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5322b513-c1e9-484f-abbb-86133289731c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:46.772668 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5322b513-c1e9-484f-abbb-86133289731c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:46.773096 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5322b513-c1e9-484f-abbb-86133289731c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:46.922171 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5322b513-c1e9-484f-abbb-86133289731c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:46.935639 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5322b513-c1e9-484f-abbb-86133289731c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.175545 May 18 17:23:46.936646 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 585/1182] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:46 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:47.564580 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-27abd537-36e6-4b37-9766-0d2206e4a78f req-a6c1a84d-3c6d-4890-9605-2a472b3728a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e", "name": "network-vif-plugged", "status": "completed", "tag": "cf42a5ae-99d2-470f-8f28-a354170dd6a4"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:23:47.573107 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-27abd537-36e6-4b37-9766-0d2206e4a78f req-a6c1a84d-3c6d-4890-9605-2a472b3728a9 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:47.573643 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-27abd537-36e6-4b37-9766-0d2206e4a78f req-a6c1a84d-3c6d-4890-9605-2a472b3728a9 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:47.586697 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-27abd537-36e6-4b37-9766-0d2206e4a78f req-a6c1a84d-3c6d-4890-9605-2a472b3728a9 service nova] Creating event network-vif-plugged:cf42a5ae-99d2-470f-8f28-a354170dd6a4 for instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e on hv-cinder-79578 May 18 17:23:47.592131 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-27abd537-36e6-4b37-9766-0d2206e4a78f req-a6c1a84d-3c6d-4890-9605-2a472b3728a9 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195227 May 18 17:23:47.592743 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 598/1183] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:23:47.953532 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-fffb4f70-1455-4e3a-b928-4cc815789216 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:47.954178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-fffb4f70-1455-4e3a-b928-4cc815789216 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:47.961995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fffb4f70-1455-4e3a-b928-4cc815789216 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:47.962451 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fffb4f70-1455-4e3a-b928-4cc815789216 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:47.963215 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fffb4f70-1455-4e3a-b928-4cc815789216 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:47.963651 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-fffb4f70-1455-4e3a-b928-4cc815789216 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:48.110076 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-fffb4f70-1455-4e3a-b928-4cc815789216 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:48.118918 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-fffb4f70-1455-4e3a-b928-4cc815789216 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.169217 May 18 17:23:48.119723 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 586/1184] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:47 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:49.140325 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-f311b002-bf26-49c1-960d-e1ffcd8df1a1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:49.141045 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-f311b002-bf26-49c1-960d-e1ffcd8df1a1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:49.149332 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f311b002-bf26-49c1-960d-e1ffcd8df1a1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:49.149824 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f311b002-bf26-49c1-960d-e1ffcd8df1a1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:49.150607 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f311b002-bf26-49c1-960d-e1ffcd8df1a1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:49.151049 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-f311b002-bf26-49c1-960d-e1ffcd8df1a1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:49.303325 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-f311b002-bf26-49c1-960d-e1ffcd8df1a1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:49.311071 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-f311b002-bf26-49c1-960d-e1ffcd8df1a1 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1266 microversion: 2.1 time: 0.175074 May 18 17:23:49.311956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 599/1185] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:49 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:50.328827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b4c7ecdf-19b5-41b7-924c-495b4409571c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:50.329409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b4c7ecdf-19b5-41b7-924c-495b4409571c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:50.337034 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4c7ecdf-19b5-41b7-924c-495b4409571c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:50.337474 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4c7ecdf-19b5-41b7-924c-495b4409571c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:50.338266 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4c7ecdf-19b5-41b7-924c-495b4409571c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:50.338696 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b4c7ecdf-19b5-41b7-924c-495b4409571c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:50.480418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b4c7ecdf-19b5-41b7-924c-495b4409571c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:50.487872 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b4c7ecdf-19b5-41b7-924c-495b4409571c tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1452 microversion: 2.1 time: 0.163035 May 18 17:23:50.488429 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 587/1186] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:50 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:50.507337 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-697ab7ae-b9f6-4e80-bdcb-c2fb38656445 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:23:50.508037 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-697ab7ae-b9f6-4e80-bdcb-c2fb38656445 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:23:50.515972 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-697ab7ae-b9f6-4e80-bdcb-c2fb38656445 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:50.516429 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-697ab7ae-b9f6-4e80-bdcb-c2fb38656445 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:50.517210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-697ab7ae-b9f6-4e80-bdcb-c2fb38656445 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:50.517695 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-697ab7ae-b9f6-4e80-bdcb-c2fb38656445 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:50.686142 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-697ab7ae-b9f6-4e80-bdcb-c2fb38656445 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:23:50.694390 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-697ab7ae-b9f6-4e80-bdcb-c2fb38656445 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1452 microversion: 2.1 time: 0.193469 May 18 17:23:50.694955 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 600/1187] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:23:50 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1452 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:23:52.487178 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-f30513cb-b051-455c-8794-0c503ad967a6 req-c148f929-f36b-4de5-8ef1-0f5f5c7012f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e", "tag": "cf42a5ae-99d2-470f-8f28-a354170dd6a4"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:23:52.496558 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-f30513cb-b051-455c-8794-0c503ad967a6 req-c148f929-f36b-4de5-8ef1-0f5f5c7012f0 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:23:52.497000 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-f30513cb-b051-455c-8794-0c503ad967a6 req-c148f929-f36b-4de5-8ef1-0f5f5c7012f0 service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:23:52.509607 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-f30513cb-b051-455c-8794-0c503ad967a6 req-c148f929-f36b-4de5-8ef1-0f5f5c7012f0 service nova] Creating event network-changed:cf42a5ae-99d2-470f-8f28-a354170dd6a4 for instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e on hv-cinder-79578 May 18 17:23:52.523774 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-f30513cb-b051-455c-8794-0c503ad967a6 req-c148f929-f36b-4de5-8ef1-0f5f5c7012f0 service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104481 May 18 17:23:52.525029 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 588/1188] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:24:17.399186 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:24:17.399808 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Wed May 18 17:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:24:22.850209 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:24:22.850849 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Wed May 18 17:24:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:25:51.554434 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:25:51.555811 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:25:51.559793 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1000439387", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1878139194", "security_groups": [{"name": "tempest-secgroup-smoke-178296769"}], "block_device_mapping_v2": [{"uuid": "077b7fd7-40d2-4a9f-926c-840042bcc8e9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d3758902-7248-457c-ac74-050337304611"}]}} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:25:51.672308 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.network.neutron [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] validate_networks() for [('d3758902-7248-457c-ac74-050337304611', None, None, None, None, None)] {{(pid=117731) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 18 17:25:52.142931 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Flavor limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 18 17:25:52.143360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Image limits 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 18 17:25:52.143847 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Flavor pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 18 17:25:52.144265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Image pref 0:0:0 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 18 17:25:52.144684 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.virt.hardware [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117731) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 18 17:25:52.154242 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:52.154699 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:52.155504 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:52.155977 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:52.173000 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Getting quotas for project 467c9f16c74546a68e59acbff2542cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 18 17:25:52.176961 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.quota [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Getting quotas for user 53394412ea1f463196acd85c7e11621c and project 467c9f16c74546a68e59acbff2542cc2. Resources: {'ram', 'cores', 'instances'} {{(pid=117731) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 18 17:25:52.236305 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Going to run 1 instances... {{(pid=117731) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 18 17:25:52.238425 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='077b7fd7-40d2-4a9f-926c-840042bcc8e9',volume_size=None,volume_type=None)] {{(pid=117731) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 18 17:25:52.377124 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-05983aa4-3fbd-4586-a760-a1dc99fa15e2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824305 May 18 17:25:52.377816 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 601/1189] 10.222.0.49 () {60 vars in 1146 bytes} [Wed May 18 17:25:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 18 17:25:52.388713 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99abb0b2-0c18-4d6b-a137-bde8bc02368a] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 18 17:25:52.389336 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:25:52.390250 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=74 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:25:52.397337 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-195a61fa-d530-4d87-a3a2-399c205d2db5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:25:52.397950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-195a61fa-d530-4d87-a3a2-399c205d2db5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:25:52.458872 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-195a61fa-d530-4d87-a3a2-399c205d2db5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:25:52.466677 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-195a61fa-d530-4d87-a3a2-399c205d2db5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1095 microversion: 2.1 time: 0.081387 May 18 17:25:52.467324 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 589/1190] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:25:52 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:25:53.489580 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b574a783-15e6-4317-8082-2d39c312c134 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:25:53.490334 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b574a783-15e6-4317-8082-2d39c312c134 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:25:53.497760 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b574a783-15e6-4317-8082-2d39c312c134 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:53.498237 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b574a783-15e6-4317-8082-2d39c312c134 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:53.499019 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b574a783-15e6-4317-8082-2d39c312c134 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:53.499460 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b574a783-15e6-4317-8082-2d39c312c134 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:53.587518 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b574a783-15e6-4317-8082-2d39c312c134 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:25:53.597024 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b574a783-15e6-4317-8082-2d39c312c134 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1211 microversion: 2.1 time: 0.113380 May 18 17:25:53.597598 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 602/1191] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:25:53 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:25:54.614816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-84c69c99-17c9-4814-8a6d-839910fabf5b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:25:54.615579 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-84c69c99-17c9-4814-8a6d-839910fabf5b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:25:54.628742 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c69c99-17c9-4814-8a6d-839910fabf5b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:54.629886 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c69c99-17c9-4814-8a6d-839910fabf5b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:54.630719 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c69c99-17c9-4814-8a6d-839910fabf5b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:54.631165 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-84c69c99-17c9-4814-8a6d-839910fabf5b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:54.638438 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] [99abb0b2-0c18-4d6b-a137-bde8bc02368a] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 39918. May 18 17:25:54.790601 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-84c69c99-17c9-4814-8a6d-839910fabf5b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:25:54.806069 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-84c69c99-17c9-4814-8a6d-839910fabf5b tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.195119 May 18 17:25:54.816866 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 590/1192] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:25:54 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:25:54.978968 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-c1c03b3e-0ead-4fc8-b891-4c5013e3b4af req-6b52e8b1-8a72-4350-8037-9a2905c861ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f6ce1b-01a8-4862-8b19-6b0470b74e2c", "tag": "771414fb-64d8-4f40-afe7-6a2d9d30d24a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:25:54.988371 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c1c03b3e-0ead-4fc8-b891-4c5013e3b4af req-6b52e8b1-8a72-4350-8037-9a2905c861ca service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:54.989310 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-c1c03b3e-0ead-4fc8-b891-4c5013e3b4af req-6b52e8b1-8a72-4350-8037-9a2905c861ca service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:55.002073 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-c1c03b3e-0ead-4fc8-b891-4c5013e3b4af req-6b52e8b1-8a72-4350-8037-9a2905c861ca service nova] Creating event network-changed:771414fb-64d8-4f40-afe7-6a2d9d30d24a for instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c on hv-cinder-79578 May 18 17:25:55.007784 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-c1c03b3e-0ead-4fc8-b891-4c5013e3b4af req-6b52e8b1-8a72-4350-8037-9a2905c861ca service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122302 May 18 17:25:55.008535 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 603/1193] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:25:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:25:55.825407 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-65b007d5-b2e3-438b-9a3e-fd86dac86437 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:25:55.826065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-65b007d5-b2e3-438b-9a3e-fd86dac86437 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:25:55.832649 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-65b007d5-b2e3-438b-9a3e-fd86dac86437 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:55.833098 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-65b007d5-b2e3-438b-9a3e-fd86dac86437 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:55.833903 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-65b007d5-b2e3-438b-9a3e-fd86dac86437 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:55.834343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-65b007d5-b2e3-438b-9a3e-fd86dac86437 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:55.979013 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-65b007d5-b2e3-438b-9a3e-fd86dac86437 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:25:55.986715 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-65b007d5-b2e3-438b-9a3e-fd86dac86437 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.166277 May 18 17:25:55.987292 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 591/1194] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:25:55 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:25:57.003500 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-ca227402-7581-4b0b-a53a-7093485e530e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:25:57.004245 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-ca227402-7581-4b0b-a53a-7093485e530e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:25:57.011259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ca227402-7581-4b0b-a53a-7093485e530e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:57.011714 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ca227402-7581-4b0b-a53a-7093485e530e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:57.012589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ca227402-7581-4b0b-a53a-7093485e530e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:57.013028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-ca227402-7581-4b0b-a53a-7093485e530e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:57.155100 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-ca227402-7581-4b0b-a53a-7093485e530e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:25:57.164292 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-ca227402-7581-4b0b-a53a-7093485e530e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.164910 May 18 17:25:57.164900 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 604/1195] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:25:56 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:25:58.182950 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-b0474013-d05d-49e6-b939-58551d3b6297 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:25:58.183591 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-b0474013-d05d-49e6-b939-58551d3b6297 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:25:58.190541 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b0474013-d05d-49e6-b939-58551d3b6297 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:58.190995 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b0474013-d05d-49e6-b939-58551d3b6297 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:58.191766 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b0474013-d05d-49e6-b939-58551d3b6297 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:58.192199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-b0474013-d05d-49e6-b939-58551d3b6297 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:58.328341 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-b0474013-d05d-49e6-b939-58551d3b6297 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:25:58.335842 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-b0474013-d05d-49e6-b939-58551d3b6297 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.157920 May 18 17:25:58.336465 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 592/1196] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:25:58 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:25:59.352725 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-15ee36b2-eb09-4962-bf70-67f06f3fcf00 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:25:59.353357 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-15ee36b2-eb09-4962-bf70-67f06f3fcf00 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:25:59.359751 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-15ee36b2-eb09-4962-bf70-67f06f3fcf00 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:59.360529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-15ee36b2-eb09-4962-bf70-67f06f3fcf00 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:59.361971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-15ee36b2-eb09-4962-bf70-67f06f3fcf00 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:25:59.362767 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-15ee36b2-eb09-4962-bf70-67f06f3fcf00 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:25:59.501495 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-15ee36b2-eb09-4962-bf70-67f06f3fcf00 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:25:59.509072 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-15ee36b2-eb09-4962-bf70-67f06f3fcf00 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.160363 May 18 17:25:59.509627 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 605/1197] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:25:59 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:00.527682 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-5d0d34a3-4fac-44a2-8789-a438f2cfed6d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:00.528321 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-5d0d34a3-4fac-44a2-8789-a438f2cfed6d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:00.534838 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5d0d34a3-4fac-44a2-8789-a438f2cfed6d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:00.535294 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5d0d34a3-4fac-44a2-8789-a438f2cfed6d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:00.536057 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5d0d34a3-4fac-44a2-8789-a438f2cfed6d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:00.536495 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-5d0d34a3-4fac-44a2-8789-a438f2cfed6d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:00.664767 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-5d0d34a3-4fac-44a2-8789-a438f2cfed6d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:00.672553 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-5d0d34a3-4fac-44a2-8789-a438f2cfed6d tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.149334 May 18 17:26:00.673120 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 593/1198] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:00 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:01.690321 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-b127ad1b-6c59-4809-bd21-48c2b8f16910 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:01.690942 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-b127ad1b-6c59-4809-bd21-48c2b8f16910 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:01.697627 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b127ad1b-6c59-4809-bd21-48c2b8f16910 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:01.698133 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b127ad1b-6c59-4809-bd21-48c2b8f16910 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:01.698940 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b127ad1b-6c59-4809-bd21-48c2b8f16910 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:01.699381 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-b127ad1b-6c59-4809-bd21-48c2b8f16910 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:01.839397 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-b127ad1b-6c59-4809-bd21-48c2b8f16910 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:01.847071 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-b127ad1b-6c59-4809-bd21-48c2b8f16910 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.160698 May 18 17:26:01.847630 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 606/1199] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:01 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:02.864488 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-abf57c09-c5ed-4653-a91c-41c51339db94 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:02.865044 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-abf57c09-c5ed-4653-a91c-41c51339db94 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:02.867390 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell0:SELECT=2 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:26:02.873777 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abf57c09-c5ed-4653-a91c-41c51339db94 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:02.874221 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abf57c09-c5ed-4653-a91c-41c51339db94 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:02.874977 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abf57c09-c5ed-4653-a91c-41c51339db94 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:02.875408 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-abf57c09-c5ed-4653-a91c-41c51339db94 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:03.010435 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-abf57c09-c5ed-4653-a91c-41c51339db94 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:03.018055 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-abf57c09-c5ed-4653-a91c-41c51339db94 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.157471 May 18 17:26:03.018627 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 594/1200] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:02 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:04.035438 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-140f72e4-de7d-450b-a2ef-066b680147c2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:04.036058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-140f72e4-de7d-450b-a2ef-066b680147c2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:04.038103 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=2 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:26:04.038771 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell0:SELECT=6 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:26:04.047852 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-140f72e4-de7d-450b-a2ef-066b680147c2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:04.048530 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-140f72e4-de7d-450b-a2ef-066b680147c2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:04.049812 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-140f72e4-de7d-450b-a2ef-066b680147c2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:04.050520 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-140f72e4-de7d-450b-a2ef-066b680147c2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:04.205956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-140f72e4-de7d-450b-a2ef-066b680147c2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:04.213827 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-140f72e4-de7d-450b-a2ef-066b680147c2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.182283 May 18 17:26:04.214550 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 607/1201] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:04 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:05.231971 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-67ce2588-f90b-4a1f-8dbf-9686ecd955ac tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:05.232515 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-67ce2588-f90b-4a1f-8dbf-9686ecd955ac tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:05.239037 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-67ce2588-f90b-4a1f-8dbf-9686ecd955ac tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:05.239487 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-67ce2588-f90b-4a1f-8dbf-9686ecd955ac tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:05.240247 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-67ce2588-f90b-4a1f-8dbf-9686ecd955ac tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:05.240681 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-67ce2588-f90b-4a1f-8dbf-9686ecd955ac tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:05.428317 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-67ce2588-f90b-4a1f-8dbf-9686ecd955ac tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:05.436409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-67ce2588-f90b-4a1f-8dbf-9686ecd955ac tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.209079 May 18 17:26:05.436986 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 595/1202] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:05 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:06.103836 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-3b866bc5-c209-46ee-8a52-c4dd23d83cc0 req-dc92a55d-dd91-4d64-9438-f55c90102acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f6ce1b-01a8-4862-8b19-6b0470b74e2c", "name": "network-vif-plugged", "status": "completed", "tag": "771414fb-64d8-4f40-afe7-6a2d9d30d24a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:26:06.113382 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-3b866bc5-c209-46ee-8a52-c4dd23d83cc0 req-dc92a55d-dd91-4d64-9438-f55c90102acc service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:06.113921 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-3b866bc5-c209-46ee-8a52-c4dd23d83cc0 req-dc92a55d-dd91-4d64-9438-f55c90102acc service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:06.128605 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-3b866bc5-c209-46ee-8a52-c4dd23d83cc0 req-dc92a55d-dd91-4d64-9438-f55c90102acc service nova] Creating event network-vif-plugged:771414fb-64d8-4f40-afe7-6a2d9d30d24a for instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c on hv-cinder-79578 May 18 17:26:06.134946 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-3b866bc5-c209-46ee-8a52-c4dd23d83cc0 req-dc92a55d-dd91-4d64-9438-f55c90102acc service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035338 May 18 17:26:06.135847 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 608/1203] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 18 17:26:06.453752 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-49ce8773-d0db-4ded-858c-f6dcff087953 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:06.454372 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-49ce8773-d0db-4ded-858c-f6dcff087953 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:06.460956 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49ce8773-d0db-4ded-858c-f6dcff087953 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:06.461409 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49ce8773-d0db-4ded-858c-f6dcff087953 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:06.462199 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49ce8773-d0db-4ded-858c-f6dcff087953 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:06.462643 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-49ce8773-d0db-4ded-858c-f6dcff087953 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:06.594721 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-49ce8773-d0db-4ded-858c-f6dcff087953 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:06.602653 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-49ce8773-d0db-4ded-858c-f6dcff087953 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.152764 May 18 17:26:06.603225 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 596/1204] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:06 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:07.620865 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-faf0e195-7368-4722-8fc8-3dd950774b6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:07.621569 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-faf0e195-7368-4722-8fc8-3dd950774b6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:07.628358 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-faf0e195-7368-4722-8fc8-3dd950774b6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:07.628746 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-faf0e195-7368-4722-8fc8-3dd950774b6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:07.629509 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-faf0e195-7368-4722-8fc8-3dd950774b6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:07.629977 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-faf0e195-7368-4722-8fc8-3dd950774b6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:07.761543 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-faf0e195-7368-4722-8fc8-3dd950774b6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:07.769034 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-faf0e195-7368-4722-8fc8-3dd950774b6a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1266 microversion: 2.1 time: 0.152420 May 18 17:26:07.769592 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 609/1205] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:07 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:08.786833 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-c3f407a6-a9df-48ee-a106-1f935d9a2358 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:08.787434 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-c3f407a6-a9df-48ee-a106-1f935d9a2358 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:08.794352 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3f407a6-a9df-48ee-a106-1f935d9a2358 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:08.794795 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3f407a6-a9df-48ee-a106-1f935d9a2358 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:08.795552 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3f407a6-a9df-48ee-a106-1f935d9a2358 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:08.795978 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-c3f407a6-a9df-48ee-a106-1f935d9a2358 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:08.927687 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-c3f407a6-a9df-48ee-a106-1f935d9a2358 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:08.936265 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-c3f407a6-a9df-48ee-a106-1f935d9a2358 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1453 microversion: 2.1 time: 0.153287 May 18 17:26:08.936827 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 597/1206] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:08 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:08.953721 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a27742b8-b65e-4ae2-8a8b-a3e6235db684 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:26:08.954432 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a27742b8-b65e-4ae2-8a8b-a3e6235db684 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:26:08.960912 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a27742b8-b65e-4ae2-8a8b-a3e6235db684 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:08.961370 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a27742b8-b65e-4ae2-8a8b-a3e6235db684 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:08.962170 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a27742b8-b65e-4ae2-8a8b-a3e6235db684 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:08.962616 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a27742b8-b65e-4ae2-8a8b-a3e6235db684 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:09.095053 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-a27742b8-b65e-4ae2-8a8b-a3e6235db684 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:26:09.103046 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a27742b8-b65e-4ae2-8a8b-a3e6235db684 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1453 microversion: 2.1 time: 0.154234 May 18 17:26:09.103624 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 610/1207] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:26:08 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:26:11.094418 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-dd5f9038-46c7-4422-925c-d9cee883504f req-d7d05743-13cd-4a22-bf40-d8353ab3ce2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f6ce1b-01a8-4862-8b19-6b0470b74e2c", "tag": "771414fb-64d8-4f40-afe7-6a2d9d30d24a"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:26:11.103903 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-dd5f9038-46c7-4422-925c-d9cee883504f req-d7d05743-13cd-4a22-bf40-d8353ab3ce2a service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:26:11.104671 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-dd5f9038-46c7-4422-925c-d9cee883504f req-d7d05743-13cd-4a22-bf40-d8353ab3ce2a service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:26:11.115858 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-dd5f9038-46c7-4422-925c-d9cee883504f req-d7d05743-13cd-4a22-bf40-d8353ab3ce2a service nova] Creating event network-changed:771414fb-64d8-4f40-afe7-6a2d9d30d24a for instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c on hv-cinder-79578 May 18 17:26:11.121114 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-dd5f9038-46c7-4422-925c-d9cee883504f req-d7d05743-13cd-4a22-bf40-d8353ab3ce2a service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030495 May 18 17:26:11.121748 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 598/1208] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:26:13.021935 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:26:13.022592 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:26:59.628222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:26:59.628932 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:26:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:27:42.858917 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:27:42.860058 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Wed May 18 17:27:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:28:11.216016 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR oslo.messaging._drivers.impl_rabbit [-] [99abb0b2-0c18-4d6b-a137-bde8bc02368a] AMQP server on 10.222.0.49:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 18 17:28:11.216686 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_api:SELECT=22 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:11.218032 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR oslo.messaging._drivers.impl_rabbit [-] [d857eb54-d120-4ae7-b106-2af56d5b9ec9] AMQP server on 10.222.0.49:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 18 17:28:11.218958 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:11.220365 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG dbcounter [-] [117732] Writing DB stats nova_cell1:SELECT=50 {{(pid=117732) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:11.227304 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-7300589d-5587-48ad-b485-63a23c7e23e9 req-a363f86e-6bb4-4db3-afd4-de18415270dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7f6ce1b-01a8-4862-8b19-6b0470b74e2c", "tag": "771414fb-64d8-4f40-afe7-6a2d9d30d24a"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:28:11.231953 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG dbcounter [-] [117731] Writing DB stats nova_cell1:SELECT=48 {{(pid=117731) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 18 17:28:11.237377 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-46fff45b-a079-46ac-8a72-1f7167cb9359 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:11.237920 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-46fff45b-a079-46ac-8a72-1f7167cb9359 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:11.246708 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-7300589d-5587-48ad-b485-63a23c7e23e9 req-a363f86e-6bb4-4db3-afd4-de18415270dd service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:11.247160 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-7300589d-5587-48ad-b485-63a23c7e23e9 req-a363f86e-6bb4-4db3-afd4-de18415270dd service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:11.253980 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46fff45b-a079-46ac-8a72-1f7167cb9359 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:11.254445 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46fff45b-a079-46ac-8a72-1f7167cb9359 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:11.255232 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46fff45b-a079-46ac-8a72-1f7167cb9359 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:11.255676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-46fff45b-a079-46ac-8a72-1f7167cb9359 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:11.258644 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-7300589d-5587-48ad-b485-63a23c7e23e9 req-a363f86e-6bb4-4db3-afd4-de18415270dd service nova] Creating event network-changed:771414fb-64d8-4f40-afe7-6a2d9d30d24a for instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c on hv-cinder-79578 May 18 17:28:11.264343 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-7300589d-5587-48ad-b485-63a23c7e23e9 req-a363f86e-6bb4-4db3-afd4-de18415270dd service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050088 May 18 17:28:11.265192 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 599/1209] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:28:11.287003 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-46fff45b-a079-46ac-8a72-1f7167cb9359 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:28:11.373819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-46fff45b-a079-46ac-8a72-1f7167cb9359 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "DELETE /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 204 len: 0 microversion: 2.1 time: 0.161966 May 18 17:28:11.374620 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 611/1210] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:28:11 2022] DELETE /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:28:11.385491 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-9de60aae-33e8-47fd-bb3b-f09908b9a9d5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:11.386374 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-9de60aae-33e8-47fd-bb3b-f09908b9a9d5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:11.395907 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9de60aae-33e8-47fd-bb3b-f09908b9a9d5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:11.396662 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9de60aae-33e8-47fd-bb3b-f09908b9a9d5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:11.397453 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9de60aae-33e8-47fd-bb3b-f09908b9a9d5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:11.397920 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-9de60aae-33e8-47fd-bb3b-f09908b9a9d5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:11.541417 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-9de60aae-33e8-47fd-bb3b-f09908b9a9d5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:28:11.549576 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-9de60aae-33e8-47fd-bb3b-f09908b9a9d5 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1577 microversion: 2.1 time: 0.169414 May 18 17:28:11.550206 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 600/1211] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:11 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:28:12.567558 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-492f4144-302a-4ad0-ab83-9e8ba7c52854 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:12.568257 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-492f4144-302a-4ad0-ab83-9e8ba7c52854 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:12.577010 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-492f4144-302a-4ad0-ab83-9e8ba7c52854 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:12.577462 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-492f4144-302a-4ad0-ab83-9e8ba7c52854 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:12.578254 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-492f4144-302a-4ad0-ab83-9e8ba7c52854 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:12.578693 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-492f4144-302a-4ad0-ab83-9e8ba7c52854 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:12.585261 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] [d857eb54-d120-4ae7-b106-2af56d5b9ec9] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40012. May 18 17:28:12.892571 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-492f4144-302a-4ad0-ab83-9e8ba7c52854 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:28:12.900168 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-492f4144-302a-4ad0-ab83-9e8ba7c52854 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1577 microversion: 2.1 time: 0.336854 May 18 17:28:12.900737 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 612/1212] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:12 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1577 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:28:13.919222 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-8895eca6-d835-49c8-ac41-4cd3e629bf41 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:13.919821 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-8895eca6-d835-49c8-ac41-4cd3e629bf41 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:13.928179 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8895eca6-d835-49c8-ac41-4cd3e629bf41 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:13.928625 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8895eca6-d835-49c8-ac41-4cd3e629bf41 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:13.929383 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8895eca6-d835-49c8-ac41-4cd3e629bf41 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:13.929840 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-8895eca6-d835-49c8-ac41-4cd3e629bf41 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:13.935518 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] [99abb0b2-0c18-4d6b-a137-bde8bc02368a] Reconnected to AMQP server on 10.222.0.49:5672 via [amqp] client with port 40020. May 18 17:28:14.149627 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-8895eca6-d835-49c8-ac41-4cd3e629bf41 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:28:14.149882 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [req-17f33f1f-f9d2-4665-99fa-93c3c601762c req-1155a165-4f01-4e3c-a646-e0a4add9592c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7f6ce1b-01a8-4862-8b19-6b0470b74e2c", "name": "network-vif-deleted", "tag": "771414fb-64d8-4f40-afe7-6a2d9d30d24a"}]} {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:28:14.158902 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-8895eca6-d835-49c8-ac41-4cd3e629bf41 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 200 len: 1459 microversion: 2.1 time: 0.243395 May 18 17:28:14.159993 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 601/1213] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:13 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 1459 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:28:14.163143 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-17f33f1f-f9d2-4665-99fa-93c3c601762c req-1155a165-4f01-4e3c-a646-e0a4add9592c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:14.163584 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [req-17f33f1f-f9d2-4665-99fa-93c3c601762c req-1155a165-4f01-4e3c-a646-e0a4add9592c service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:14.176736 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.compute.server_external_events [req-17f33f1f-f9d2-4665-99fa-93c3c601762c req-1155a165-4f01-4e3c-a646-e0a4add9592c service nova] Creating event network-vif-deleted:771414fb-64d8-4f40-afe7-6a2d9d30d24a for instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c on hv-cinder-79578 May 18 17:28:14.184227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [req-17f33f1f-f9d2-4665-99fa-93c3c601762c req-1155a165-4f01-4e3c-a646-e0a4add9592c service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039020 May 18 17:28:14.184844 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 613/1214] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:28:15.177398 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:15.178295 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: c7f6ce1b-01a8-4862-8b19-6b0470b74e2c] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:15.185139 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:15.185584 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:15.186619 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:15.187223 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:15.202353 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] HTTP exception thrown: Instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c could not be found. May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Request method failure captured: May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c HTTP/1.1 May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSqQuoS42h5t48R6K_qlsI6oAAuRe9P_v3yP4mW54RSS0Jsh5_RrmAzkW6IHBzFXDGipiHOPgTwb5WtbbubfOBhew9w5Kiw3kpm4k7m6AVzPxvb7mKTWKTqTCw3m8GK5luIMucRYaYxr94Qllj51Ipb_W4eagGq5UmTNq9t0nY9LU_I May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:28:15.204025 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-TestVolumeBootPattern-685432326 May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-TestVolumeBootPattern-685432326-project May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 53394412ea1f463196acd85c7e11621c May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-TestVolumeBootPattern-685432326-project May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c could not be found. May 18 17:28:15.206180 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': 'c7f6ce1b-01a8-4862-8b19-6b0470b74e2c'} May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c could not be found. May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:28:15.207071 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c could not be found. May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c could not be found. May 18 17:28:15.208616 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:15.210073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Returning 404 to user: Instance c7f6ce1b-01a8-4862-8b19-6b0470b74e2c could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:28:15.210073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-cb05f570-13bc-44a9-b8f5-192676b1d005 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c" status: 404 len: 111 microversion: 2.1 time: 0.032514 May 18 17:28:15.210073 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 602/1215] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:15 2022] GET /compute/v2.1/servers/c7f6ce1b-01a8-4862-8b19-6b0470b74e2c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:28:18.267480 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-03888dc3-6767-448a-9ea3-3a6eb69eb59a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:18.268124 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-03888dc3-6767-448a-9ea3-3a6eb69eb59a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:18.269526 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-0dd7907a-9ca3-4af4-89c9-1b4df703725b req-ec2ef8f9-385a-4043-aac1-9b5c56b8d6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e", "tag": "cf42a5ae-99d2-470f-8f28-a354170dd6a4"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:28:18.275052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-03888dc3-6767-448a-9ea3-3a6eb69eb59a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:18.275506 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-03888dc3-6767-448a-9ea3-3a6eb69eb59a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:18.276278 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-03888dc3-6767-448a-9ea3-3a6eb69eb59a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:18.276717 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-03888dc3-6767-448a-9ea3-3a6eb69eb59a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:18.278125 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-0dd7907a-9ca3-4af4-89c9-1b4df703725b req-ec2ef8f9-385a-4043-aac1-9b5c56b8d6ac service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:18.278923 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-0dd7907a-9ca3-4af4-89c9-1b4df703725b req-ec2ef8f9-385a-4043-aac1-9b5c56b8d6ac service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:18.290841 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-0dd7907a-9ca3-4af4-89c9-1b4df703725b req-ec2ef8f9-385a-4043-aac1-9b5c56b8d6ac service nova] Creating event network-changed:cf42a5ae-99d2-470f-8f28-a354170dd6a4 for instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e on hv-cinder-79578 May 18 17:28:18.296100 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-0dd7907a-9ca3-4af4-89c9-1b4df703725b req-ec2ef8f9-385a-4043-aac1-9b5c56b8d6ac service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030623 May 18 17:28:18.297142 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 603/1216] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:28:18.307166 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-03888dc3-6767-448a-9ea3-3a6eb69eb59a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Going to try to terminate instance {{(pid=117731) delete /opt/stack/nova/nova/compute/api.py:2664}} May 18 17:28:18.399657 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-03888dc3-6767-448a-9ea3-3a6eb69eb59a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "DELETE /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 204 len: 0 microversion: 2.1 time: 0.135836 May 18 17:28:18.401733 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 614/1217] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:28:18 2022] DELETE /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 18 17:28:18.410797 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-e7598a78-2400-4a2e-8587-dba6cf24179a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:18.411514 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-e7598a78-2400-4a2e-8587-dba6cf24179a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:18.418082 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7598a78-2400-4a2e-8587-dba6cf24179a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:18.418539 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7598a78-2400-4a2e-8587-dba6cf24179a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:18.419369 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7598a78-2400-4a2e-8587-dba6cf24179a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:18.419816 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-e7598a78-2400-4a2e-8587-dba6cf24179a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:18.590566 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.policy [None req-e7598a78-2400-4a2e-8587-dba6cf24179a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117732) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:28:18.599115 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-e7598a78-2400-4a2e-8587-dba6cf24179a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1577 microversion: 2.1 time: 0.192730 May 18 17:28:18.599684 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 604/1218] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:18 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1577 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:28:19.617457 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-c7637d55-6869-428d-9ad2-058eed2731da tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:19.618184 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-c7637d55-6869-428d-9ad2-058eed2731da tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:19.624589 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c7637d55-6869-428d-9ad2-058eed2731da tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:19.625052 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c7637d55-6869-428d-9ad2-058eed2731da tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:19.625873 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c7637d55-6869-428d-9ad2-058eed2731da tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:19.626966 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-c7637d55-6869-428d-9ad2-058eed2731da tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:20.017793 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-c7637d55-6869-428d-9ad2-058eed2731da tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:28:20.025259 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-c7637d55-6869-428d-9ad2-058eed2731da tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1577 microversion: 2.1 time: 0.412050 May 18 17:28:20.025853 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 615/1219] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:19 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1577 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:28:20.591445 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [req-efe8434c-6a44-412b-a9b5-4728a52a8909 req-0f97af6b-8e37-44e4-a91e-675b0cde11fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e", "name": "network-vif-deleted", "tag": "cf42a5ae-99d2-470f-8f28-a354170dd6a4"}]} {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 18 17:28:20.613196 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-efe8434c-6a44-412b-a9b5-4728a52a8909 req-0f97af6b-8e37-44e4-a91e-675b0cde11fb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:20.613712 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [req-efe8434c-6a44-412b-a9b5-4728a52a8909 req-0f97af6b-8e37-44e4-a91e-675b0cde11fb service nova] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:20.625812 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.compute.server_external_events [req-efe8434c-6a44-412b-a9b5-4728a52a8909 req-0f97af6b-8e37-44e4-a91e-675b0cde11fb service nova] Creating event network-vif-deleted:cf42a5ae-99d2-470f-8f28-a354170dd6a4 for instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e on hv-cinder-79578 May 18 17:28:20.631462 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [req-efe8434c-6a44-412b-a9b5-4728a52a8909 req-0f97af6b-8e37-44e4-a91e-675b0cde11fb service nova] 10.222.0.49 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044116 May 18 17:28:20.632050 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 605/1220] 10.222.0.49 () {64 vars in 1317 bytes} [Wed May 18 17:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 18 17:28:21.042529 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:21.043184 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:21.051189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:21.051642 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:21.052422 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:21.052863 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:21.086028 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:21.086491 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:21.086944 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.objects.instance [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lazy-loading 'fault' on Instance uuid 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e {{(pid=117731) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 18 17:28:21.129971 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.policy [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53394412ea1f463196acd85c7e11621c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467c9f16c74546a68e59acbff2542cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117731) authorize /opt/stack/nova/nova/policy.py:199}} May 18 17:28:21.140210 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-bf82f4e4-8091-4c32-8a01-c7b1d547fb98 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 200 len: 1231 microversion: 2.1 time: 0.101089 May 18 17:28:21.141227 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 616/1221] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:21 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 1231 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 18 17:28:22.159736 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:22.160441 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:22.166815 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:22.167268 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:22.168042 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:22.168480 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:22.182024 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] HTTP exception thrown: Instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e could not be found. May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Request method failure captured: May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e HTTP/1.1 May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSqQuoS42h5t48R6K_qlsI6oAAuRe9P_v3yP4mW54RSS0Jsh5_RrmAzkW6IHBzFXDGipiHOPgTwb5WtbbubfOBhew9w5Kiw3kpm4k7m6AVzPxvb7mKTWKTqTCw3m8GK5luIMucRYaYxr94Qllj51Ipb_W4eagGq5UmTNq9t0nY9LU_I May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:28:22.183688 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-TestVolumeBootPattern-685432326 May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-TestVolumeBootPattern-685432326-project May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 53394412ea1f463196acd85c7e11621c May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-TestVolumeBootPattern-685432326-project May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e could not be found. May 18 17:28:22.185599 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e'} May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e could not be found. May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:28:22.186622 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e could not be found. May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e could not be found. May 18 17:28:22.188255 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:22.190556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Returning 404 to user: Instance 0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:28:22.190556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-efacfcf3-dcd0-4140-95eb-fd7524d9854a tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e" status: 404 len: 111 microversion: 2.1 time: 0.030912 May 18 17:28:22.190556 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 606/1222] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:22 2022] GET /compute/v2.1/servers/0f672e8e-acf7-4fd4-a97d-73abb5fdfd8e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:28:22.951213 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:22.951776 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.compute.api [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117731) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:22.958819 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:22.959265 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:22.960031 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:22.960463 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG oslo_concurrency.lockutils [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117731) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:22.975482 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.wsgi [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] HTTP exception thrown: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Request method failure captured: May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: request: DELETE /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 HTTP/1.1 May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept: application/json May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Accept-Encoding: identity May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Connection: close May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Length: 0 May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Content-Type: application/json May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Host: 10.222.0.49 May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Openstack-System-Scope: None May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: User-Agent: python-urllib3/1.26.9 May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Auth-Token: gAAAAABihSqQuoS42h5t48R6K_qlsI6oAAuRe9P_v3yP4mW54RSS0Jsh5_RrmAzkW6IHBzFXDGipiHOPgTwb5WtbbubfOBhew9w5Kiw3kpm4k7m6AVzPxvb7mKTWKTqTCw3m8GK5luIMucRYaYxr94Qllj51Ipb_W4eagGq5UmTNq9t0nY9LU_I May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Id: None May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Domain-Name: None May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Identity-Status: Confirmed May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Is-Admin-Project: True May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Id: default May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Domain-Name: Default May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Project-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Role: reader,member May 18 17:28:22.977189 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Roles: reader,member May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant: tempest-TestVolumeBootPattern-685432326 May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-Tenant-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User: tempest-TestVolumeBootPattern-685432326-project May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Id: default May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Domain-Name: Default May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Id: 53394412ea1f463196acd85c7e11621c May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: X-User-Name: tempest-TestVolumeBootPattern-685432326-project May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: method: > May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: exception: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:22.978967 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: action_args: {'id': '6b6ed6b2-128c-48f2-a895-5729c9e0eda2'} May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:28:22.979956 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:22.981676 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: ERROR nova.api.openstack.wsgi May 18 17:28:22.983301 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Returning 404 to user: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. {{(pid=117731) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:28:22.983301 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-a0675ff1-0bd9-4199-a636-794e78c70d3e tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "DELETE /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 404 len: 111 microversion: 2.1 time: 0.031328 May 18 17:28:22.983301 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 617/1223] 10.222.0.49 () {58 vars in 1238 bytes} [Wed May 18 17:28:22 2022] DELETE /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:28:22.988597 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '>' {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:22.989263 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.compute.api [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] [instance: 6b6ed6b2-128c-48f2-a895-5729c9e0eda2] Fetching instance by UUID {{(pid=117732) get /opt/stack/nova/nova/compute/api.py:2920}} May 18 17:28:22.995521 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:22.995963 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:22.996738 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 18 17:28:22.997174 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG oslo_concurrency.lockutils [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Lock "0d1c70ba-b105-4b40-8414-d9986bf93793" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117732) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 18 17:28:23.012124 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.wsgi [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] HTTP exception thrown: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Request method failure captured: May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: request: GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 HTTP/1.1 May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept: application/json May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Accept-Encoding: identity May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Connection: close May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Length: 0 May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Content-Type: application/json May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Host: 10.222.0.49 May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Openstack-System-Scope: None May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: User-Agent: python-urllib3/1.26.9 May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Auth-Token: gAAAAABihSqQuoS42h5t48R6K_qlsI6oAAuRe9P_v3yP4mW54RSS0Jsh5_RrmAzkW6IHBzFXDGipiHOPgTwb5WtbbubfOBhew9w5Kiw3kpm4k7m6AVzPxvb7mKTWKTqTCw3m8GK5luIMucRYaYxr94Qllj51Ipb_W4eagGq5UmTNq9t0nY9LU_I May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Id: None May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Domain-Name: None May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Identity-Status: Confirmed May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Is-Admin-Project: True May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Id: default May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Domain-Name: Default May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Project-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Role: reader,member May 18 17:28:23.013683 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Roles: reader,member May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.49:8080", "publicURL": "http://10.222.0.49:8080/v1/AUTH_467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/volume/v3/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2/467c9f16c74546a68e59acbff2542cc2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.49/compute/v2.1"}]}] May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant: tempest-TestVolumeBootPattern-685432326 May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Id: 467c9f16c74546a68e59acbff2542cc2 May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-Tenant-Name: tempest-TestVolumeBootPattern-685432326 May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User: tempest-TestVolumeBootPattern-685432326-project May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Id: default May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Domain-Name: Default May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Id: 53394412ea1f463196acd85c7e11621c May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: X-User-Name: tempest-TestVolumeBootPattern-685432326-project May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: method: > May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: exception: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:23.015794 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: action_args: {'id': '6b6ed6b2-128c-48f2-a895-5729c9e0eda2'} May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: {{(pid=117732) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 18 17:28:23.017065 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. May 18 17:28:23.018740 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: ERROR nova.api.openstack.wsgi May 18 17:28:23.020148 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: DEBUG nova.api.openstack.wsgi [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Returning 404 to user: Instance 6b6ed6b2-128c-48f2-a895-5729c9e0eda2 could not be found. {{(pid=117732) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 18 17:28:23.020148 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO nova.api.openstack.requestlog [None req-f0d4a1fb-d142-4eed-a260-53c1c46fa189 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2" status: 404 len: 111 microversion: 2.1 time: 0.031230 May 18 17:28:23.020148 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: [pid: 117732|app: 0|req: 607/1224] 10.222.0.49 () {58 vars in 1235 bytes} [Wed May 18 17:28:22 2022] GET /compute/v2.1/servers/6b6ed6b2-128c-48f2-a895-5729c9e0eda2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 18 17:28:24.341712 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: DEBUG nova.api.openstack.wsgi [None req-12c1027c-7ddd-4888-ac1d-9460642a5dd2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] Calling method '.version_select at 0x7feef3cd5550>' {{(pid=117731) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 18 17:28:24.366159 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO nova.api.openstack.requestlog [None req-12c1027c-7ddd-4888-ac1d-9460642a5dd2 tempest-TestVolumeBootPattern-685432326 tempest-TestVolumeBootPattern-685432326-project] 10.222.0.49 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1878139194" status: 202 len: 0 microversion: 2.1 time: 0.028356 May 18 17:28:24.366773 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: [pid: 117731|app: 0|req: 618/1225] 10.222.0.49 () {58 vars in 1262 bytes} [Wed May 18 17:28:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1878139194 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 18 17:29:33.030467 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:29:33.031112 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:29:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:30:19.636042 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:30:19.636736 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:30:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:30:57.413448 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:30:57.414126 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Wed May 18 17:30:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:31:02.867467 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:31:02.868138 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Wed May 18 17:31:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:31:17.688552 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:31:17.689360 dv-cinder-795785-11-iscsi devstack@n-api.service[117731]: Wed May 18 17:31:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:32:53.040592 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:32:53.041282 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:32:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:33:23.456334 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:33:23.457218 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 18 17:33:39.644191 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 18 17:33:39.644717 dv-cinder-795785-11-iscsi devstack@n-api.service[117732]: Wed May 18 17:33:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!